operations/storage/retention.md

9 …boltdb-shipper](../boltdb-shipper) store and chunk/index store. However retention through the [Com…
12 The Compactor retention will become the default and have long term support. It supports more granul…
16 … can deduplicate index entries. It can also apply granular retention. When applying retention with…
20 Compaction and retention are idempotent. If the compactor restarts, it will continue from where it …
22 The Compactor loops to apply compaction and retention at every `compaction_interval`, or as soon as…
32 The retention algorithm is applied to the index. Chunks are not deleted while applying the retentio…
44 This compactor configuration example activates retention.
48   working_directory: /data/retention
72 > Note that retention is only available if the index period is 24h.
82 …ictates how often compaction and/or retention is applied. If the Compactor falls behind, compactio…
88 #### Configuring the retention period
92 There are two ways of setting retention policies:
97 > The minimum retention period is 24h.
99 This example configures global retention:
113 Per tenant retention can be defined using the `/etc/overrides.yaml` files. For example:
139 5. If no global `retention_period` is specified, the default value of `744h` (30days) retention is …
150 - All tenants except `29` and `30` in the `dev` namespace will have a retention period of `24h` hou…
151 - All tenants except `29` and `30` that are not in the `dev` namespace will have the retention peri…
153 …- All streams except those in the container `loki` or in the namespace `prod` will have retention …
154 …- All streams in the `prod` namespace will have a retention period of `336h` (2 weeks), even if th…
155 … the container label `loki` but are not in the namespace `prod` will have a `72h` retention period.
157 …- All streams except those having the container label `nginx` will have the global retention perio…
158   - Streams that have the label `nginx` will have a retention period of `24h`.
162 In order to enable the retention support, the Table Manager needs to be
163 configured to enable deletions and a retention period. Please refer to the
166 Alternatively, the `table-manager.retention-period` and
167 `table-manager.retention-deletes-enabled` command line flags can be used. The
168 provided retention period needs to be a duration represented as a string that
171 > **WARNING**: The retention period must be a multiple of the index and chunks table
173 block. See the [Table Manager](../table-manager#retention) documentation for
176 > **NOTE**: To avoid querying of data beyond the retention period,
186 Currently, the retention policy can only be set globally. A per-tenant retention
202 Example configuration with GCS with a 28 day retention: