# Persistence When running Weaviate with Docker or Kubernetes, you can persist its data by mounting a volume to store the data outside of the containers. Doing so will cause the Weaviate instance to also load the data from the mounted volume when it is restarted. Note that Weaviate now offers native backup modules starting with `v1.15` for single-node instances, and `v1.16` for multi-node instances. For older versions of Weaviate, persisting data as described here will allow you to back up Weaviate. ## Docker Compose ### Persistence When running Weaviate with Docker Compose, you can set the `volumes` variable under the `weaviate` service and a unique cluster hostname as an environment variable. ```yaml services: weaviate: volumes: - /var/weaviate:/var/lib/weaviate environment: CLUSTER_HOSTNAME: 'node1' PERSISTENCE_DATA_PATH: '/var/lib/weaviate' ``` - About the volumes - `/var/weaviate` is the location where you want to store the data on the local machine - `/var/lib/weaviate` The value after the colon (:) is the storage location inside the container. This value must match the PERSISTENCE\_DATA\_PATH variable. - About the hostname - `CLUSTER_HOSTNAME` can be any name In the case you want a more verbose output, you can change the environment variable for the `LOG_LEVEL` ```yaml services: weaviate: environment: LOG_LEVEL: 'debug' ``` A complete example of a Weaviate without modules but with an externally mounted volume and more verbose output: ```yaml --- services: weaviate: command: - --host - 0.0.0.0 - --port - '8080' - --scheme - http image: cr.weaviate.io/semitechnologies/weaviate:1.38.2 ports: - 8080:8080 - 50051:50051 restart: on-failure:0 volumes: - /var/weaviate:/var/lib/weaviate # <== set a volume here environment: QUERY_DEFAULTS_LIMIT: 25 AUTHENTICATION_ANONYMOUS_ACCESS_ENABLED: 'true' PERSISTENCE_DATA_PATH: '/var/lib/weaviate' CLUSTER_HOSTNAME: 'node1' # <== this can be set to an arbitrary name ... ``` ### Backups See [Backups](backups.md). ## Kubernetes For Kubernetes setup, the only thing to bear in mind is that Weaviate needs a `PersistentVolumes` through `PersistentVolumeClaims` ([more info](../installation/installation-guides-k8s-installation.md#requirements)) but the Helm chart is already configured to store the data on an external volume. ## Disk Pressure Warnings and Limits Starting with `v1.12.0` there are two levels of disk usage notifications and actions configured through environment variables. Both variables are optional. If not set they default to the values outlined below: | Variable | Default Value | Description | | ------------------------------ | ------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------ | | `DISK_USE_WARNING_PERCENTAGE` | `80` | If disk usage is higher than the given percentage a warning will be logged by all shards on the affected node's disk | | `DISK_USE_READONLY_PERCENTAGE` | `90` | If disk usage is higher than the given percentage all shards on the affected node will be marked as `READONLY`, meaning all future write requests will fail. | If a shard was marked `READONLY` due to disk pressure and you want to mark the shard as ready again (either because you have made more space available or changed the thresholds) you can use the [Shards API](/weaviate/api/rest#tag/schema/get/schema/%7BclassName%7D/shards) to do so. ## Disk access method Weaviate maps data on disk to memory. To configure how Weaviate uses virtual memory, set the `PERSISTENCE_LSM_ACCESS_STRATEGY` environment variable. The default value is `mmap`. Use `pread` to as an alternative. The two functions reflect different under-the-hood memory management behaviors. `mmap` uses a memory-mapped file, which means that the file is mapped into the virtual memory of the process. `pread` is a function that reads data from a file descriptor at a given offset. In general, `mmap` may be a preferred option with memory management benefits. However, if you experience stalling situations under heavy memory load, we suggest trying `pread` instead. ## Object Time-To-Live (TTL) :::callout{intent="info" title="Added in `v1.36`"} ::: You can configure automatic deletion of objects after a specified time period using Time-To-Live (TTL) settings at the collection level. Read more [about it](../concepts/data.md#time-to-live-ttl) or how to [set it up](../how-to-manage-collections/time-to-live.md). ## Related pages - [Configuration: Backups](backups.md) - [Concepts: Storage - HNSW snapshots](../concepts/storage.md#hnsw-snapshots) ## Questions and feedback Have a question or feedback? Here's how to reach us. ::::card-grid :::card{title="Community Forum" href="https://forum.weaviate.io/c/support" icon="messages-square"} Ask questions and connect with other developers on our **Community forum**. ::: :::card{title="Support" href="/guides/support-overview" icon="life-buoy"} Weaviate Cloud user or customer? Find the right channel on the **Support page**. ::: :::: ## Related pages - [Agents](./agents-index.md) - [AI-assisted Weaviate code generation](./ai-assisted-vibe-coding-index.md) - [APIs](./apis-index.md) - [Authorization and authentication](./authorization-and-authentication-index.md) - [Benchmarks](./benchmarks-index.md) - [Best practices](./best-practices-index.md) - [Client libraries](./clients-index.md) - [Client Libraries / SDKs](./client-libraries-index.md) - [Cloud](./cloud-index.md) - [Cloud account management](./cloud-account-management-index.md) # Agent Instructions This portal answers questions programmatically. To receive a synthesized, source-cited answer instead of crawling page by page, append the `?ask=` query parameter to any page URL on this site: /guides/quickstart?ask=how+do+I+authenticate Optional parameters: - `&goal=` steers the answer toward your objective (e.g. `&goal=write+a+python+client`). - `&version=