Commit graph

761 commits

Author SHA1 Message Date
Vault Automation
e7965c8bdf
[VAULT-41294] docker: build OCI container images (#11545) (#11549)
This change does a few things that might not be obvious:

- We stop requesting the previous runner image. This will result in us
  using Docker 29 instead of 28. With this comes changes in our
  container build system, most notably that container images are now
  exported as OCI images. Every container runtime that we support also
  supports OCI images so this ought to have no meaningful impact to
  downstream users. One noticeable change is that the image layers are
  now compressed so the final image size on disk will be considerably
  smaller than before.

- Upgrade `hashicorp/action-setup-enos` to the latest version. This is not
  strictly required for this change but as we just released a new version of
  the CLI it makes sense to update it here. We should also note that recently
  we released a new version of `terraform-provider-enos` which contains
  necessary for this change as our docker and kind resources needed to be
  updated handle OCI and Docker exported images. Previously they relied on
  files that existed only in Docker images.

Signed-off-by: Ryan Cragun <me@ryan.ec>
Co-authored-by: Ryan Cragun <me@ryan.ec>
2025-12-29 10:58:02 -08:00
Vault Automation
0c6c13dd38
license: update headers to IBM Corp. (#10229) (#10233)
* license: update headers to IBM Corp.
* `make proto`
* update offset because source file changed

Signed-off-by: Ryan Cragun <me@ryan.ec>
Co-authored-by: Ryan Cragun <me@ryan.ec>
2025-10-21 15:20:20 -06:00
Vault Automation
c9605c7eb0
VAULT-36947: Support force unloading a snapshot (#8740) (#9036)
* portion of changes for autoloading

* add test checking for panic

* add endpoint for force unloading

* separate method for force unload

* changelog

* don't redefine constants

Co-authored-by: miagilepner <mia.epner@hashicorp.com>
2025-09-01 09:16:35 +00:00
miagilepner
a18b4dfc9b
VAULT-37080: Fix changelog and comment (#31449) 2025-08-07 17:24:07 +00:00
miagilepner
beeb8c2032
VAULT-37080: Maintain redundancy zones for unhealthy nodes (#31443)
* ce changes

* changelog
2025-08-07 17:01:02 +02:00
Steven Davidovitz
9ff8f7e4c2
fix(gcs): failed locks due to upstream library error check changes (#31274)
After https://github.com/googleapis/google-cloud-go/pull/11519, errors
must be checked with `errors.Is`.

Addresses #31125.

Co-authored-by: Mike Palmiotto <mike.palmiotto@hashicorp.com>
2025-07-31 12:22:58 -04:00
Violet Hynes
584a3daf21
Dependency updates for main (#31299)
* Dependency updates for main

* go mod tidy
2025-07-17 11:30:11 -04:00
Tauhid Anjum
d9ecd5bd10
PostgreSQL backend passwordless authentication in cloud (#30681)
* PostgreSQL backend passwordless authentication in cloud

* updated changelog file name

* Update the changelog

Co-authored-by: Paul Banks <banks@banksco.de>

* fix image spec sha

---------

Co-authored-by: Paul Banks <banks@banksco.de>
2025-06-04 08:44:20 +02:00
JMGoldsmith
c4457366b3
Revert "PostgreSQL backend passwordless authentication in cloud (#30564)" (#30668)
This reverts commit 2dd0a1626e.
2025-05-19 16:57:51 +00:00
miagilepner
bea32a14ab
VAULT-35369: Loaded snapshots CE (#30529)
* full load

* snapshot manager tested

* integration test

* more tetsts

* remove obselete test

* fix failing test

* move tesdata to ent folder

* add test for RaftDataDirPath

* fix race condition, don't create new barrier instance

* check for nil result

* remove encryption from the barrier storage wrapper

* Update physical/raft/fsm.go

Co-authored-by: Kuba Wieczorek <kuba.wieczorek@hashicorp.com>

* fmt

---------

Co-authored-by: Kuba Wieczorek <kuba.wieczorek@hashicorp.com>
2025-05-16 14:27:04 +02:00
Tauhid Anjum
2dd0a1626e
PostgreSQL backend passwordless authentication in cloud (#30564)
* PostgreSQL backend passwordless authentication in cloud

* adding changelog

* Updating deprecated docker test types

* adding unit tests for getAuthConfig

* removing cloud auth based tests due to failure in CI. Unit test should focus on the default flow.

* Adding function name for lint
2025-05-13 15:52:02 +02:00
Kuba Wieczorek
57da716ad0
Fix misformatted comment causing the CE-ENT diff to fail (#30439) 2025-04-29 14:59:26 +00:00
Kuba Wieczorek
dbc2f06fbd
[VAULT-35190] Implement logic for writing snapshot data to an FSM (#30416) 2025-04-29 14:43:53 +01:00
Miles
9231f5dac2
Support reading mysql backend credentials from environment variables (#30136)
Signed-off-by: Miles <miles.wilson@wolterskluwer.com>
Co-authored-by: Violet Hynes <violet.hynes@hashicorp.com>
2025-04-02 12:46:46 -04:00
davidadeleon
6741773b0f
update vault auth submodules to api/v1.16.0 (#29548)
* update vault auth submodules to api/v1.16.0

* update go.mod

* make proto

---------

Co-authored-by: davidadeleon <ddeleon@hashicorp.com>
2025-02-11 07:28:45 -08:00
Nick Cabatoff
38c3e15e1e
Add support for reloading raft config (#29485) 2025-02-05 15:08:46 +00:00
miagilepner
46ee2d0024
Fix log level when starting a raft node (#29459) 2025-01-30 11:46:55 +01:00
Johan Brandhorst-Satzkorn
8d83c5d047
physical: use permitpool from go-secure-stdlib (#29331)
* sdk/physical: use permitpool from go-secure-stdlib

* physical: use permitpool from go-secure-stdlib

* fixup! sdk/physical: use permitpool from go-secure-stdlib

* fixup! sdk/physical: use permitpool from go-secure-stdlib
2025-01-24 12:33:44 -05:00
Mike Palmiotto
9d80c4548f
proto: bump protoc-gen-go to 1.36.3 (#29359) 2025-01-22 13:58:43 -05:00
Michael Diggin
5b4b606c0d
[Storage/DynamoDB] Let vault modify dynamodb tables (#29371)
* [Storage/DynamoDB] Let vault modify dynamodb tables

* add changelog

---------

Co-authored-by: Violet Hynes <violet.hynes@hashicorp.com>
2025-01-21 14:27:54 -05:00
miagilepner
dc0cd5af90
Exit raft removed checker if raft isn't initialized (#29329)
* check if not initialized

* add comment and fix flake
2025-01-10 14:16:43 -03:00
Josh Black
f625f506ed
CE changes for vault-31750 (#29303)
* ce changes for vault-31750

* add changelog

* make proto

* refactor naming

* clarify error message

* update changelog

* one more time

* make proto AGAIN
2025-01-09 11:58:29 -08:00
Ryan Cragun
357b2949e3
protobuf: rebuild protos with protobuf 1.36.2 (#29318)
* protobuf: rebuild protos with protobuf 1.36.2
* format: please buf formatter

Signed-off-by: Ryan Cragun <me@ryan.ec>
2025-01-08 21:35:04 +00:00
miagilepner
4f32443722
fixes for flakes in raft removed tests (#29270)
* fixes for flakes in raft removed tests

* one more fix
2025-01-07 13:56:07 +01:00
Ryan Cragun
f730d31bc6
protobuf: rebuild protos with protobuf 1.36 (#29229)
Signed-off-by: Ryan Cragun <me@ryan.ec>
2025-01-03 14:19:00 -07:00
miagilepner
9bde015070
VAULT-31758: Store when a node is removed in the raft stable store (#29090)
* implementation and test

* changelog

* verify servers are healthy before removing
2024-12-11 12:31:59 +01:00
miagilepner
5ed2f81102
VAULT-32568: Shutdown node when it's not in the raft config (#29052)
* add implementation and tests

* add eventually condition for test flake
2024-12-03 13:27:29 +01:00
Josh Black
2269cc3f7c
remove hashicorp-forge/bbolt and replace with official beta release (#28916)
* remove hashicorp-forge/bbolt and replace with official beta release

* get rid of redundant method

* go mod tidy

* make proto
2024-11-18 11:18:50 -08:00
divyaac
52ba156d47
Fix protoc issue (#28928) 2024-11-15 19:33:48 +00:00
miagilepner
d717b48f90
fix flaky TestRaft_Removed (#28817) 2024-10-31 14:48:22 +01:00
miagilepner
41c0a3040b
VAULT-31748: add removable node HA backend interface and raft implementation (#28726) 2024-10-30 18:19:49 +01:00
Ryan Cragun
b6145bc3bb
protobuf: rebuild protos with protobuf 1.35.1 (main) (#28617)
* protobuf: rebuild protos with protobuf 1.35.1
* protobuf: unpin protoc-gen-go-grpc on main

Signed-off-by: Ryan Cragun <me@ryan.ec>
2024-10-07 14:54:51 -06:00
VAL
53bb78ce5f
Log when MAP_POPULATE gets disabled (#28526)
* add warning for when MAP_POPULATE mmap flag not set

* Make mmap flags method handle any flags, where MAP_POPULATE is just one of them

* Only have the log print out on restores

* Add test, make logic more consistent

* Add changelog

* Add godoc for test

* Make test less dangerous
2024-10-02 12:27:25 -07:00
Brian Howe
fc5ed22fd1
pass context to S3 and dynamoDB storage calls (#27927)
* pass context to S3 and dynamoDB storage calls

* add changelog

* fix changelog
2024-09-23 08:46:15 -04:00
miagilepner
b5621aa368
VAULT-28477 Bootstrap and persist autopilot versions (#28186)
* add versions to raft bootstrap answer

* remove version faking

* save version state to storage

* logging and copy

* changelog

* use leader versions on upgrade

* add enterprise cluster test

* never drop persisted states

* rename to partialCopy, fix comment, fix log line
2024-08-30 08:32:26 +00:00
idnandre
e26c246cbb
chore: fix deprecated ioutil readall (#27823)
Signed-off-by: idnandre <andre@idntimes.com>
2024-07-30 09:18:24 -04:00
John-Michael Faircloth
d6a588b8d2
db: refactor postgres test helpers (#27811)
* db: refactor postgres test helpers

* fix references to refactored test helper

* fix references to refactored test helper

* fix failing test
2024-07-19 09:47:34 -05:00
Jason O'Donnell
2a09bd47ba
raft/autopilot: fix panic during autopilot shutdown (#27726)
* raft/autopilot: fix panic during autopilot shutdown

* changelog
2024-07-09 16:52:40 +00:00
idnandre
b833d4714d
chore: fix deprecated ioutil nopcloser (#27650)
Signed-off-by: idnandre <andre@idntimes.com>
2024-07-03 13:38:34 -04:00
davidadeleon
45682dc090
VAULT-28281: Pass in accountName variable into validation function (#27563)
* pass in correct accountName variable into validation function

* modify test fixture to better test validation functionality

* pass in accountName variable into error message

* changelog
2024-06-21 15:09:07 -04:00
Josh Black
f33f1b15fc
improve autopilot logging when it starts up (#27464)
* improve autopilot logging when it starts up

* add changelog
2024-06-12 11:07:14 -07:00
Steven Clark
d152de025d
Pin generated proto files to 1.34.2 (#27438) 2024-06-11 12:29:45 -04:00
Thomas Hargrove
27563039db
Speed up dynamodb List() by only getting keys (#21159)
* Speed up ddb list by only getting keys

* Add same optimization to has_children

* Add changeling

---------

Co-authored-by: Violet Hynes <violet.hynes@hashicorp.com>
2024-06-07 15:11:00 -04:00
Josh Black
1c44349bd3
Augment raft test functions to allow specifying SetupOpts (#27387) 2024-06-06 12:42:31 -07:00
Paul Banks
a04c53eca2
Fix AP upgrade version issue (#27277)
* Fix AP upgrade version issue

* add heartbeat logging at trace level

* add log to show when heartbeats resume

* Test the plumbing

* Revert "Test the plumbing"

This reverts commit e25fcd8351.

* Add CHANGELOG

* Add plumbing test

* Update misleading comment

---------

Co-authored-by: Josh Black <raskchanky@gmail.com>
2024-06-05 18:12:00 +01:00
Mike Brancato
af47fc927e
Update Azure MSI endpoint (#10624)
* Update Azure MSI endpoint

* Add changelog

---------

Co-authored-by: Jim Kalafut <jkalafut@hashicorp.com>
Co-authored-by: Violet Hynes <violet.hynes@hashicorp.com>
Co-authored-by: Tom Chwojko-Frank <117938382+tomcf-hcp@users.noreply.github.com>
2024-06-04 10:19:18 -07:00
kilocaleb
f11f4643cf
gocql: DisableInitialHostLookup as backend configuration parameter (#9733)
* setting option for gocql: DisableInitialHostLookup thru backend config section

* adding newline between 'if' blocks to keep code strict

---------

Co-authored-by: Violet Hynes <violet.hynes@hashicorp.com>
2024-06-03 14:09:49 -04:00
Mike Palmiotto
2d75711019
make proto 1.34.1 (#26856) 2024-05-07 14:33:18 +00:00
Mike Palmiotto
195b00e77f
Bump cockroach-go to v2.3.8 (#26842)
PR https://github.com/cockroachdb/cockroach-go/pull/179 addresses
CVE-2024-27289 and CVE-2024-27304 by bumping jackc/pgx to v4.18.3.

This PR pulls in these changes by updating our cockroach-go dep to
v2.3.8.

Resolves: VAULT-26033
2024-05-07 09:20:49 -04:00
Ryan Cragun
5d763ac052
proto: rebuild with the latest protoc-gen-go (#26698)
Signed-off-by: Ryan Cragun <me@ryan.ec>
2024-04-30 13:05:49 -06:00