vault/enos/modules
Vault Automation c00eab81a7
Backport Reorganize vault blackbox tests into isolated/scenario/system structure into ce/main (#15705)
* Reorganize vault blackbox tests into isolated/scenario/system structure (#14919)

* Reorganize vault blackbox tests into isolated/scenario/system structure

- Move 38 test files from flat structure to organized directories:
  * isolated/: namespace-scoped, concurrent-safe tests (auth, secrets, plugins, verify)
  * scenario/: state-changing tests (raft, ha)
  * system/: system-level config tests (billing, license)
- Add build tags (isolated, scenario, system) to all test files
- Update enos scenarios to use new test paths (./vault/external_tests/blackbox/isolated/verify)
- Add isolated build tag to undo_logs_test.go for consistency
- Remove empty directories and duplicate test files
- All tests compile successfully with respective build tags

Updated enos scenarios: autopilot, agent, dr-replication, plugin, pr-replication, proxy, seal-ha, smoke, upgrade

* Fix test failures: skip postgres without env vars, handle userpass login failure

* Add HSM-specific build tags for test compilation

* Add metadata path permissions for KV v2 delete/undelete operations

* Fix KV tests: use user session for all write operations

* Fix KV tests: remove userpass, use root session

* Incorporate new AWS and LDAP test functions from main branch

- Add TestAWS_SecretsCreate() and TestAWS_SecretsRead() to isolated/plugins/aws/secrets_aws_test.go
  * Tests basic AWS secrets engine configuration and role creation
  * Tests reading AWS role and root configuration
  * Complements existing TestAWS_GenerateNewUser() with simpler test cases

- Add TestLDAP_StaticRoleCreate(), TestLDAP_LibrarySetRead(), and TestLDAP_LibrarySetDelete() to isolated/plugins/ldap/secrets_ldap_test.go
  * Tests LDAP static role creation for password rotation
  * Tests LDAP library set operations for service account management
  * Tests library set deletion
  * Adds requireLDAPAvailable() helper for connectivity verification
  * Complements existing dynamic credential tests

- All new test functions include:
  * Build tag: //go:build isolated
  * t.Parallel() for concurrent execution
  * Proper environment variable checks with skip logic
  * Consistent error handling and assertions

- Cleanup:
  * Removed stray .git directories from test folders
  * Removed empty vault/external_tests/blackbox/plugins directory

These changes ensure the PR includes all test coverage from main while maintaining
the new isolated/scenario/system organization structure.

* Fix pr-replication scenario to use correct test path and name

- Update test_package from ./vault/external_tests/blackbox/verify to isolated/verify
- Update test_names from TestVaultUIAvailability to TestUIAssets
- Fixes test failures caused by incomplete migration in blackbox test reorganization

* Fix all Enos scenarios: isolated/verify path and correct test names

* Skip isolated tests on CE - require enterprise features

---------

Co-authored-by: hashigator <280075563+hashigator@users.noreply.github.com>
Co-authored-by: hashigator <lt.carbonell@ibm.com>
2026-06-23 11:29:48 -04:00
..
artifact/metadata [VAULT-44881] enos: add support for Ubuntu 26.04 2026-05-18 17:39:31 +00:00
autopilot_upgrade_storageconfig license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
backend_consul license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
backend_raft license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
benchmark license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
build_artifactory_artifact license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
build_artifactory_package license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
build_crt license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
build_local [VAULT-44431] enos: merge changes for enterprise zap scenario into ce/main 2026-05-18 10:07:46 -06:00
choose_follower_host license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
cloud_docker_vault_cluster [VAULT-44431] enos: merge changes for enterprise zap scenario into ce/main 2026-05-18 10:07:46 -06:00
create_vpc license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
create_vpc_fyre_shim [VAULT-34888] enos: backport changes for Fyre scenarios for testing on linux/s390x 2026-06-22 10:21:47 -06:00
database_container [VAULT-34888] enos: backport changes for Fyre scenarios for testing on linux/s390x 2026-06-22 10:21:47 -06:00
disable_selinux [VAULT-41521] enos(ec2_infor): update scenario base images (#11508) (#11533) 2025-12-22 14:17:51 -07:00
docker_namespace_token [COMPLIANCE] Update Copyright and License Headers (#11034) (#12518) 2026-02-24 17:20:11 -07:00
docker_network [COMPLIANCE] Update Copyright and License Headers (#11034) (#12518) 2026-02-24 17:20:11 -07:00
ec2_info VAULT-43736: adding sdk node removal test (#14759) (#15158) 2026-06-04 04:47:01 -07:00
fyre_os_info [VAULT-34888] enos: backport changes for Fyre scenarios for testing on linux/s390x 2026-06-22 10:21:47 -06:00
generate_dr_operation_token license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
generate_failover_secondary_token license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
generate_secondary_public_key license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
generate_secondary_token license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
get_local_metadata license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
hcp Add blackbox testing SDK (#11210) (#12245) 2026-02-06 21:36:29 +00:00
install_packages [VAULT-41521] enos(ec2_infor): update scenario base images (#11508) (#11533) 2025-12-22 14:17:51 -07:00
k8s_deploy_vault [VAULT-44098] containers: never attempt to run setcap when running as non-root user (#13988) (#14106) 2026-04-20 12:48:55 -06:00
k8s_vault_verify_replication license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
k8s_vault_verify_ui license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
k8s_vault_verify_version license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
k8s_vault_verify_write_data license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
ldap_wait_for_search Backport enos(ldap): always verify base DN connection before setup into ce/main 2026-03-25 13:34:17 -04:00
load_docker_image license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
local_kind_cluster license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
read_license license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
replication_data license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
restart_consul license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
restart_vault license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
seal_awskms license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
seal_pkcs11 license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
seal_shamir license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
set_up_external_integration_target [VAULT-34888] enos: backport changes for Fyre scenarios for testing on linux/s390x 2026-06-22 10:21:47 -06:00
shutdown_multiple_nodes license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
shutdown_node license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
softhsm_create_vault_keys license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
softhsm_distribute_vault_keys license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
softhsm_init license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
softhsm_install [VAULT-44881] enos: add support for Ubuntu 26.04 2026-05-18 17:39:31 +00:00
start_vault [VAULT-34888] enos: backport changes for Fyre scenarios for testing on linux/s390x 2026-06-22 10:21:47 -06:00
stop_vault license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
target_ec2_fleet [VAULT-46052] ci: add weekend schedule for IAM resource cleanup 2026-06-19 17:58:00 -04:00
target_ec2_instances [VAULT-46052] ci: add weekend schedule for IAM resource cleanup 2026-06-19 17:58:00 -04:00
target_ec2_shim license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
target_ec2_spot_fleet [VAULT-46052] ci: add weekend schedule for IAM resource cleanup 2026-06-19 17:58:00 -04:00
target_fyre_vms [VAULT-34888] enos: backport changes for Fyre scenarios for testing on linux/s390x 2026-06-22 10:21:47 -06:00
vault_agent license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_cluster [VAULT-34888] enos: backport changes for Fyre scenarios for testing on linux/s390x 2026-06-22 10:21:47 -06:00
vault_failover_demote_dr_primary license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_failover_promote_dr_secondary license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_failover_update_dr_primary license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_get_cluster_ips license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_proxy license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_raft_remove_node_and_verify license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_raft_remove_peer license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_run_blackbox_test Backport Reorganize vault blackbox tests into isolated/scenario/system structure into ce/main (#15705) 2026-06-23 11:29:48 -04:00
vault_setup_dr_primary license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_setup_perf_primary license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_setup_replication_secondary license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_step_down license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_test_ui license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_unseal_replication_followers license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_update_license_ibm Backport [VAULT-42245] Add IBM license update to enos upgrade scenario into ce/main (#13165) 2026-03-25 12:04:01 -07:00
vault_upgrade license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_verify_agent_output license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_verify_autopilot license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_verify_billing_start_date license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_verify_default_lcq license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_verify_dr_replication license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_verify_ibm_license_update Backport [VAULT-42245] Add IBM license update to enos upgrade scenario into ce/main (#13165) 2026-03-25 12:04:01 -07:00
vault_verify_performance_replication Update perf replication checking script (#10134) (#10500) 2025-11-03 10:49:34 -08:00
vault_verify_raft_auto_join_voter license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_verify_removed_node license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_verify_removed_node_shim license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_wait_for_cluster_unsealed license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_wait_for_leader license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
vault_wait_for_seal_rewrap license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
verify_aws_secrets_engine [VAULT-34888] enos: backport changes for Fyre scenarios for testing on linux/s390x 2026-06-22 10:21:47 -06:00
verify_log_secrets Backport [VAULT-42245] Add IBM license update to enos upgrade scenario into ce/main (#13165) 2026-03-25 12:04:01 -07:00
verify_seal_type license: update headers to IBM Corp. (#10229) (#10233) 2025-10-21 15:20:20 -06:00
verify_secrets_engines [VAULT-34888] enos: backport changes for Fyre scenarios for testing on linux/s390x 2026-06-22 10:21:47 -06:00