Important Notes

  1. The Oxide CLI, Go SDK, and Terraform Provider have been updated for API enhancements described under New Features. Please be sure to upgrade.

  2. IP pools now have a version field ("v4" or "v6"), which is set at create time (omicron#8885, omicron#8951). Pools can only contain IPs of one version. Accordingly, the IP pool utilization API response no longer includes separate counts for IPv4 and IPv6 (omicron#8928). If you have custom integrations relying on this endpoint, be sure to review the latest API docs and update your integrations as needed.

Installation

Oxide Computer Model 0 must be installed and configured under the guidance of Oxide technicians. The requirement may change in future releases.

Upgrade Compatibility

Upgrade from version 16 or 16.1 is supported. We recommend shutting down all running instances on the rack before software update commences. Any instances that aren’t stopped for software update are transitioned to the failed state when the control plane comes up. They can be configured to start automatically with auto-restart policy or they can be started manually by the user.

All existing setup and data (e.g., projects, users, instances) remain intact after the software update.

New Features

Self-service system update

We now support online update of system software. This new update mechanism enables operators to manage system updates independently without Oxide involvement. The API and web console are used for initiating and monitoring the update process.

System update in the web console

This first version of online update does not support live migration. While a given instance will likely be up for most of the duration of the update, the timing and duration of instance reboots and downtime are unpredictable. For this reason, we recommend shutting down running instances during the process. More details about the impact and current limitations of system update can be found in the System Update guide.

SCIM v2.0 support

The System for Cross-Domain Identity Management (SCIM) protocol defines a standardized schema and API for managing users and groups in a centralized Identity Provider (IdP) and synchronizing them to a service provider. Prior to this release, users and groups could only be imported on a just-in-time (JIT) basis from the IdP during login events. SCIM is now available as an option for instant data synchonization from the identity provider along with SAML authentication. This new integration option allows operators to configure silo access permissions ahead of the first user login. See the Identity Providers guide for the configuration requirements and an end-to-end example with Okta as the IdP.

Note
SCIM v2.0 implementations vary across different identity providers. Schema and API variations may cause certain user/group CRUD workflows to behave in unexpected ways. See the above IdP integration guide to understand which parts of the protocol are covered by Oxide’s SCIM implementation.

Limited collaborator role

We’ve added a limited_collaborator role alongside our existing viewer, collaborator, and admin roles. A limited collaborator can create and manage instances and related resources like disks, but they cannot modify the networking resources nested under VPCs, like subnets, firewall rules, and internet gateways. See the Access Control guide for more details.

Web console

  • Operators can use the new System Update page to track update progress, list available releases, and initiate an update by setting a target release. The ability to upload a release through the console will be added in a future release; for now, use the CLI.

  • To support SCIM, we added a tab to the silo detail page where you can manage tokens for authenticating the IdP’s requests to our SCIM endpoints.

  • We added support for the new limited collaborator role on the silo and project access pages and improved the help copy on the role assignment form.

Full console changelog

Bug fixes and other enhancements

Known Behavior and Limitations

End-user features

Feature AreaKnown Issue/LimitationIssue Number

Disk/image management

Disks in importing_from_bulk_writes state cannot be deleted directly. The procedure for unsticking a canceled disk import can be used as a workaround.

Disk/image management

Disk rejected by guest OS due to duplicate nvme device names. The issue is caused by a 20-character limit in applying the disk name to the device serial number. See the Troubleshooting guide for more information.

-

Disk/image management

The ability to modify image metadata is not available at this time.

Instance orchestration

Instances fail to start when one of the switch zones is unavailable.

Instance orchestration

New instances cannot be created when the total number of NAT entries (private-to-external IP mappings) in the system exceeds 1024.

Instance performance

The tsc clocksource is treated as unreliable by guest, resulting in its fallback to use substantially slower timestamp syscalls. A workaround for this issue can be found in the Troubleshooting guide.

Instance performance

Linux guests unable to capture hardware events using perf record. A workaround for this issue can be found in the Troubleshooting guide.

VPC internet gateway

Changing a silo’s default IP pool causes some instances to lose their outbound internet access. This is due to a mismatch between the pool containing the instances' external IP (which are allocated from the new default pool) and the pool attached to the system-created internet gateways (which are linked to the old pool during creation time). Please see the Troubleshooting guide for some possible options for restoring instance outbound connectivity.

VPC routing

Subnet update clears custom router ID when the field is left out of the request body.

VPC routing

Network interface update clears transit ips when the field is left out of the request body.

-

Telemetry

VM instance memory utilization and VPC network/firewall metrics are unavailable at this time.

-

Operator features

Feature AreaKnown Issue/LimitationIssue Number

Silo management

The ability to modify silo and IDP metadata is not available at this time.

omicron#3400, omicron#3125

System management

Sled and physical storage availability real-time status are not available in the inventory UI and API yet.

omicron#2035

System management

Operator-driven instance migration across sleds is currently unavailable.

-

System management

Some running instances transitioned to the "stopped" state after online update.

omicron#9177

System management

Disk I/O issues observed after online update (see also suggested mitigations)

crucible#1788