1## Main 2* [4400](https://github.com/grafana/loki/pull/4400) **trevorwhitney**: Config: automatically apply memberlist config too all rings when provided 3* [4435](https://github.com/grafana/loki/pull/4435) **trevorwhitney**: Change default values for two GRPC settings so querier can connect to frontend/scheduler 4* [4440](https://github.com/grafana/loki/pull/4440) **DylanGuedes**: Config: Override distributor's default ring KV store 5* [4443](https://github.com/grafana/loki/pull/4443) **DylanGuedes**: Loki: Change how push API checks for contentType 6* [4415](https://github.com/grafana/loki/pull/4415) **DylanGuedes**: Change default limits to common values 7 8# 2.3.0 (2021/08/06) 9 10Release notes for 2.3.0 can be found on the [release notes page](https://grafana.com/docs/loki/latest/release-notes/v2-3/) 11 12### All Changes 13 14#### Loki 15* [4048](https://github.com/grafana/loki/pull/4048) **dannykopping**: Ruler: implementing write relabelling on recording rule samples 16* [4091](https://github.com/grafana/loki/pull/4091) **cyriltovena**: Fixes instant queries in the frontend. 17* [4087](https://github.com/grafana/loki/pull/4087) **cyriltovena**: Fixes unaligned shards between ingesters and storage. 18* [4047](https://github.com/grafana/loki/pull/4047) **cyriltovena**: Add min_sharding_lookback limits to the frontends 19* [4027](https://github.com/grafana/loki/pull/4027) **jdbaldry**: fix: Restore /config endpoint and correct handlerFunc for buildinfo 20* [4020](https://github.com/grafana/loki/pull/4020) **simonswine**: Restrict path segments in TenantIDs (CVE-2021-36156 CVE-2021-36157) 21* [4019](https://github.com/grafana/loki/pull/4019) **cyriltovena**: Improve decoding of JSON responses. 22* [4018](https://github.com/grafana/loki/pull/4018) **sandeepsukhani**: Compactor improvements 23* [4017](https://github.com/grafana/loki/pull/4017) **aknuds1**: Chore: Upgrade Prometheus and Cortex 24* [3996](https://github.com/grafana/loki/pull/3996) **owen-d**: fixes a badly referenced variable name in StepEvaluator code 25* [3995](https://github.com/grafana/loki/pull/3995) **owen-d**: Headblock interop 26* [3992](https://github.com/grafana/loki/pull/3992) **MichelHollands**: Update Cortex version 27* [3991](https://github.com/grafana/loki/pull/3991) **periklis**: Add LogQL AST walker 28* [3990](https://github.com/grafana/loki/pull/3990) **cyriltovena**: Intern label keys for LogQL parser. 29* [3986](https://github.com/grafana/loki/pull/3986) **kavirajk**: Ip matcher for LogQL 30* [3984](https://github.com/grafana/loki/pull/3984) **jeschkies**: Filter instant queries and shard them. 31* [3983](https://github.com/grafana/loki/pull/3983) **cyriltovena**: Reject labels with invalid runes when using implicit extraction parser. 32* [3981](https://github.com/grafana/loki/pull/3981) **owen-d**: fixes chunk size method in facade 33* [3979](https://github.com/grafana/loki/pull/3979) **MichelHollands**: Add a chunk filterer field to the config 34* [3977](https://github.com/grafana/loki/pull/3977) **sandeepsukhani**: add a metric for counting number of failures in opening existing active index files 35* [3976](https://github.com/grafana/loki/pull/3976) **sandeepsukhani**: fix flaky retention tests 36* [3974](https://github.com/grafana/loki/pull/3974) **owen-d**: WAL Replay counter 37* [3973](https://github.com/grafana/loki/pull/3973) **56quarters**: Use the Cortex wrapper for getting tenant ID from a context 38* [3972](https://github.com/grafana/loki/pull/3972) **jeschkies**: Return build info under `/loki/api/v1/status/buildinfo`. 39* [3970](https://github.com/grafana/loki/pull/3970) **sandeepsukhani**: log name of the file failed to open during startup by ingester 40* [3969](https://github.com/grafana/loki/pull/3969) **sandeepsukhani**: add some tests in compactor and fix a bug in IntervalHasExpiredChunks check in retention with tests 41* [3968](https://github.com/grafana/loki/pull/3968) **cyriltovena**: Improve head chunk allocations when reading samples. 42* [3967](https://github.com/grafana/loki/pull/3967) **sandeepsukhani**: fix a panic in compactor when retention is not enabled 43* [3966](https://github.com/grafana/loki/pull/3966) **sandeepsukhani**: fix panic in compactor when retention is not enabled 44* [3957](https://github.com/grafana/loki/pull/3957) **owen-d**: Unordered head block 45* [3949](https://github.com/grafana/loki/pull/3949) **cyriltovena**: Allow no overrides config for tenants. 46* [3946](https://github.com/grafana/loki/pull/3946) **cyriltovena**: Improve marker file current time metrics. 47* [3934](https://github.com/grafana/loki/pull/3934) **sandeepsukhani**: optimize table retetion 48* [3932](https://github.com/grafana/loki/pull/3932) **Timbus**: Parser: Allow literal control chars in logfmt decoder 49* [3929](https://github.com/grafana/loki/pull/3929) **sandeepsukhani**: remove boltdb files from ingesters on startup which do not have a index bucket 50* [3928](https://github.com/grafana/loki/pull/3928) **dannykopping**: Querier/Ingester: Fixing json expression parser bug 51* [3919](https://github.com/grafana/loki/pull/3919) **github-vincent-miszczak**: Add ingester.autoforget-unhealthy-timeout opt-in feature 52* [3888](https://github.com/grafana/loki/pull/3888) **kavirajk**: Make `overrides` configmap names and mount path as variables. 53* [3871](https://github.com/grafana/loki/pull/3871) **kavirajk**: Add explict syntax for using `pattern` parser 54* [3865](https://github.com/grafana/loki/pull/3865) **sandeepsukhani**: feat: index-gateway for boltdb-shipper index store 55* [3856](https://github.com/grafana/loki/pull/3856) **cyriltovena**: Shards Series API. 56* [3852](https://github.com/grafana/loki/pull/3852) **cyriltovena**: Shard ingester queries. 57* [3849](https://github.com/grafana/loki/pull/3849) **cyriltovena**: Logs ingester and store queries boundaries. 58* [3840](https://github.com/grafana/loki/pull/3840) **cyriltovena**: Add retention label to loki_distributor_bytes_received_total metrics 59** [3837](https://github.com/grafana/loki/pull/3837) **cyriltovena**: LogQL: Pattern Parser 60* [3835](https://github.com/grafana/loki/pull/3835) **sesky4**: lz4: update lz4 version to v4.1.7 to avoid possibly panic 61* [3833](https://github.com/grafana/loki/pull/3833) **cyriltovena**: Fixes a flaky retention test. 62* [3827](https://github.com/grafana/loki/pull/3827) **sandeepsukhani**: Logs deletion fixes 63* [3816](https://github.com/grafana/loki/pull/3816) **dannykopping**: Extracting queue interface 64* [3807](https://github.com/grafana/loki/pull/3807) **dannykopping**: Loki: allow for multiple targets 65* [3797](https://github.com/grafana/loki/pull/3797) **dannykopping**: Exposing remote writer for use in integration tests 66* [3792](https://github.com/grafana/loki/pull/3792) **MichelHollands**: Add a QueryFrontendTripperware module 67* [3785](https://github.com/grafana/loki/pull/3785) **sandeepsukhani**: just log a warning when a store type other than boltdb-shipper is detected when custom retention is enabled 68* [3772](https://github.com/grafana/loki/pull/3772) **sandeepsukhani**: initialize retention and deletion components only when they are enabled 69* [3771](https://github.com/grafana/loki/pull/3771) **sandeepsukhani**: revendor cortex to latest master 70* [3769](https://github.com/grafana/loki/pull/3769) **sandeepsukhani**: reduce allocs in delete requests manager by reusing slice for tracing non-deleted intervals for chunks 71* [3766](https://github.com/grafana/loki/pull/3766) **dannykopping**: Ruler: Recording Rules 72* [3763](https://github.com/grafana/loki/pull/3763) **cyriltovena**: Fixes parser labels hint for grouping. 73* [3762](https://github.com/grafana/loki/pull/3762) **cyriltovena**: Improve mark file processing. 74* [3758](https://github.com/grafana/loki/pull/3758) **owen-d**: exposes loki codec 75* [3746](https://github.com/grafana/loki/pull/3746) **sandeepsukhani**: Boltdb shipper deletion fixes 76* [3743](https://github.com/grafana/loki/pull/3743) **cyriltovena**: Replace satori.uuid with gofrs/uuid 77* [3736](https://github.com/grafana/loki/pull/3736) **cyriltovena**: Add fromJson to the template stage. 78* [3733](https://github.com/grafana/loki/pull/3733) **cyriltovena**: Fixes a goroutine leak in the store when doing cancellation. 79* [3706](https://github.com/grafana/loki/pull/3706) **cyriltovena**: Improve retention mark files. 80* [3700](https://github.com/grafana/loki/pull/3700) **slim-bean**: Loki: Add a flag for queriers to run standalone and only query store 81* [3693](https://github.com/grafana/loki/pull/3693) **cyriltovena**: Removes file sync syscall for compaction. 82* [3688](https://github.com/grafana/loki/pull/3688) **sandeepsukhani**: Logs deletion support for boltdb-shipper store 83* [3687](https://github.com/grafana/loki/pull/3687) **cyriltovena**: Use model.Duration for easy yaml/json marshalling. 84* [3686](https://github.com/grafana/loki/pull/3686) **cyriltovena**: Fixes a panic with the frontend when use with downstream URL. 85* [3677](https://github.com/grafana/loki/pull/3677) **cyriltovena**: Deprecate max_look_back_period in the chunk storage. 86* [3673](https://github.com/grafana/loki/pull/3673) **cyriltovena**: Pass in the now value to the retention. 87* [3672](https://github.com/grafana/loki/pull/3672) **cyriltovena**: Use pgzip in the compactor. 88* [3665](https://github.com/grafana/loki/pull/3665) **cyriltovena**: Trigger compaction prior retention. 89* [3664](https://github.com/grafana/loki/pull/3664) **owen-d**: revendor compatibility: various prom+k8s+cortex 90* [3643](https://github.com/grafana/loki/pull/3643) **cyriltovena**: Rejects push requests with streams without labels. 91* [3642](https://github.com/grafana/loki/pull/3642) **cyriltovena**: Custom Retention 92* [3641](https://github.com/grafana/loki/pull/3641) **owen-d**: removes naming collision 93* [3632](https://github.com/grafana/loki/pull/3632) **kavirajk**: replace `time.Duration` -> `model.Duration` for `Limits`. 94* [3628](https://github.com/grafana/loki/pull/3628) **kavirajk**: Add json struct tags to limits. 95* [3627](https://github.com/grafana/loki/pull/3627) **MichelHollands**: Update cortex to 1.8 96* [3623](https://github.com/grafana/loki/pull/3623) **slim-bean**: Loki/Promtail: Client Refactor 97* [3619](https://github.com/grafana/loki/pull/3619) **liguozhong**: [ui] add '/config' page 98* [3618](https://github.com/grafana/loki/pull/3618) **MichelHollands**: Add interceptor override and make ingester and cfg public 99* [3605](https://github.com/grafana/loki/pull/3605) **sandeepsukhani**: cleanup boltdb files failing to open during loading tables which are possibly corrupt 100* [3603](https://github.com/grafana/loki/pull/3603) **cyriltovena**: Adds chunk filter hook for ingesters. 101* [3602](https://github.com/grafana/loki/pull/3602) **MichelHollands**: Loli: Make the store field public 102* [3595](https://github.com/grafana/loki/pull/3595) **owen-d**: locks trailers during iteration 103* [3594](https://github.com/grafana/loki/pull/3594) **owen-d**: adds distributor replication factor metric 104* [3573](https://github.com/grafana/loki/pull/3573) **cyriltovena**: Fixes a race when using specific tenant and multi-client. 105* [3569](https://github.com/grafana/loki/pull/3569) **cyriltovena**: Add a chunk filter hook in the store. 106* [3566](https://github.com/grafana/loki/pull/3566) **cyriltovena**: Properly release the ticker in Loki client. 107* [3564](https://github.com/grafana/loki/pull/3564) **cyriltovena**: Improve matchers validations. 108* [3563](https://github.com/grafana/loki/pull/3563) **sandeepsukhani**: ignore download of missing boltdb files possibly removed during compaction 109* [3562](https://github.com/grafana/loki/pull/3562) **cyriltovena**: Fixes a test from #3216. 110* [3553](https://github.com/grafana/loki/pull/3553) **cyriltovena**: Add a target to reproduce fuzz testcase 111* [3550](https://github.com/grafana/loki/pull/3550) **cyriltovena**: Fixes a bug in MatrixStepper when sharding queries. 112* [3549](https://github.com/grafana/loki/pull/3549) **MichelHollands**: LBAC changes 113* [3544](https://github.com/grafana/loki/pull/3544) **alrs**: single import of jsoniter in logql subpackages 114* [3540](https://github.com/grafana/loki/pull/3540) **cyriltovena**: Support for single step metric query. 115* [3532](https://github.com/grafana/loki/pull/3532) **MichelHollands**: Loki: Update cortex version and fix resulting changes 116* [3530](https://github.com/grafana/loki/pull/3530) **sandeepsukhani**: split series api queries by day in query-frontend 117* [3517](https://github.com/grafana/loki/pull/3517) **cyriltovena**: Fixes a race introduced by #3434. 118* [3515](https://github.com/grafana/loki/pull/3515) **cyriltovena**: Add sprig text/template functions to template stage. 119* [3509](https://github.com/grafana/loki/pull/3509) **sandeepsukhani**: fix live tailing of logs from Loki 120* [3572](https://github.com/grafana/loki/pull/3572) **slim-bean**: Loki: Distributor log message bodySize should always reflect the compressed size 121* [3496](https://github.com/grafana/loki/pull/3496) **owen-d**: reduce replay flush threshold 122* [3491](https://github.com/grafana/loki/pull/3491) **sandeepsukhani**: make prefix for keys of objects created by boltdb-shipper configurable 123* [3487](https://github.com/grafana/loki/pull/3487) **cyriltovena**: Set the byte slice cap correctly when unsafely converting string. 124* [3471](https://github.com/grafana/loki/pull/3471) **cyriltovena**: Set a max size for the logql parser to 5k. 125* [3470](https://github.com/grafana/loki/pull/3470) **cyriltovena**: Fixes Issue 28593: loki:fuzz_parse_expr: Timeout in fuzz_parse_expr. 126* [3469](https://github.com/grafana/loki/pull/3469) **cyriltovena**: Fixes out-of-memory fuzzing issue. 127* [3466](https://github.com/grafana/loki/pull/3466) **pracucci**: Upgrade Cortex 128* [3455](https://github.com/grafana/loki/pull/3455) **garrettlish**: Implement offset modifier for range vector aggregation in LogQL 129* [3434](https://github.com/grafana/loki/pull/3434) **adityacs**: support math functions in line_format and label_format 130* [3216](https://github.com/grafana/loki/pull/3216) **sandeepsukhani**: check for stream selectors to have atleast one equality matcher 131* [3050](https://github.com/grafana/loki/pull/3050) **cyriltovena**: first_over_time and last_over_time 132 133#### Docs 134* [4031](https://github.com/grafana/loki/pull/4031) **KMiller-Grafana**: Docs: add weights to YAML metadata to order the LogQL subsections 135* [4029](https://github.com/grafana/loki/pull/4029) **bearice**: Docs: Update S3 permissions list 136* [4026](https://github.com/grafana/loki/pull/4026) **KMiller-Grafana**: Docs: correct fluentbit config value for DqueSync 137* [4024](https://github.com/grafana/loki/pull/4024) **KMiller-Grafana**: Docs: fix bad links 138* [4016](https://github.com/grafana/loki/pull/4016) **lizzzcai**: <docs>:fix typo in remote debugging docs 139* [4012](https://github.com/grafana/loki/pull/4012) **KMiller-Grafana**: Revise portions of the docs LogQL section 140* [3998](https://github.com/grafana/loki/pull/3998) **owen-d**: Fixes regexReplaceAll docs 141* [3980](https://github.com/grafana/loki/pull/3980) **KMiller-Grafana**: Docs: Revise/update the overview section. 142* [3965](https://github.com/grafana/loki/pull/3965) **mamil**: fix typos 143* [3962](https://github.com/grafana/loki/pull/3962) **KMiller-Grafana**: Docs: added new target (docs-next) to the docs' Makefile. 144* [3956](https://github.com/grafana/loki/pull/3956) **sandeepsukhani**: add config and documentation about index-gateway 145* [3938](https://github.com/grafana/loki/pull/3938) **seiffert**: Doc: List 'compactor' as valid value for target option 146* [3936](https://github.com/grafana/loki/pull/3936) **lukahartwig**: Fix typo 147* [3921](https://github.com/grafana/loki/pull/3921) **KMiller-Grafana**: Docs: revise the LogCLI subsection 148* [3911](https://github.com/grafana/loki/pull/3911) **KMiller-Grafana**: Docs: Make identification of experimental items consistent and obvious 149* [3910](https://github.com/grafana/loki/pull/3910) **KMiller-Grafana**: Docs: add structure for a release notes section 150* [3909](https://github.com/grafana/loki/pull/3909) **kavirajk**: Sync `main` branch docs to `next` folder 151* [3899](https://github.com/grafana/loki/pull/3899) **KMiller-Grafana**: Docs: correct “ and ” with " and same with single quote mark. 152* [3897](https://github.com/grafana/loki/pull/3897) **kavirajk**: Update steps to release versioned docs 153* [3882](https://github.com/grafana/loki/pull/3882) **KMiller-Grafana**: Docs: improve section on building from source 154* [3876](https://github.com/grafana/loki/pull/3876) **ivanahuckova**: Documentation: Unify spelling of backtick in documentation 155* [3873](https://github.com/grafana/loki/pull/3873) **KMiller-Grafana**: Docs: remove duplicated arch info from the overview section 156* [3875](https://github.com/grafana/loki/pull/3875) **kavirajk**: Add missing `-querier.max-concurrent` config in the doc 157* [3868](https://github.com/grafana/loki/pull/3868) **sanadhis**: docs: http_path_prefix as correct item of server_config 158* [3860](https://github.com/grafana/loki/pull/3860) **KMiller-Grafana**: Docs: Correct capitalization and formatting of "Promtail" 159* [3851](https://github.com/grafana/loki/pull/3851) **dannykopping**: Ruler: documentation for recording rules 160* [3846](https://github.com/grafana/loki/pull/3846) **crockk**: Docs: Minor syntax tweaks for consistency 161* [3843](https://github.com/grafana/loki/pull/3843) **azuwis**: multiline: Add regex stage example and note 162* [3829](https://github.com/grafana/loki/pull/3829) **arempter**: Add oauth2 docs options for promtail client 163* [3828](https://github.com/grafana/loki/pull/3828) **julienduchesne**: Fix broken link in `Windows Event Log` scraping docs 164* [3826](https://github.com/grafana/loki/pull/3826) **sandeepsukhani**: docs for logs deletion feature 165* [3824](https://github.com/grafana/loki/pull/3824) **KMiller-Grafana**: Docs: add and order missing design docs 166* [3823](https://github.com/grafana/loki/pull/3823) **KMiller-Grafana**: Docs: updates 167* [3815](https://github.com/grafana/loki/pull/3815) **paketb0te**: Docs: fixed typo in "Loki compared to other log systems" (levels -> labels) 168* [3810](https://github.com/grafana/loki/pull/3810) **alegmal**: documentation: corrected double "the the" in index.md 169* [3799](https://github.com/grafana/loki/pull/3799) **bt909**: docs: Add memached_client parameter "addresses" list 170* [3798](https://github.com/grafana/loki/pull/3798) **bt909**: docs: Change redis configuration value for enabling TLS to correct syntax 171* [3790](https://github.com/grafana/loki/pull/3790) **KMiller-Grafana**: Docs: remove unnecessary lists of sections 172* [3775](https://github.com/grafana/loki/pull/3775) **cyriltovena**: Retention doc 173* [3764](https://github.com/grafana/loki/pull/3764) **slim-bean**: Docs: fix makefile 174* [3757](https://github.com/grafana/loki/pull/3757) **fionaliao**: [docs] Remove unnecessary backtick from example 175* [3756](https://github.com/grafana/loki/pull/3756) **fredrikekre**: [docs] add LokiLogger.jl to unofficial clients. 176* [3723](https://github.com/grafana/loki/pull/3723) **oddlittlebird**: Docs: Update _index.md 177* [3720](https://github.com/grafana/loki/pull/3720) **fredrikekre**: [docs/clients] fix header for "Unofficial clients" and add a reference to said section. 178* [3715](https://github.com/grafana/loki/pull/3715) **jaddqiu**: Update troubleshooting.md 179* [3714](https://github.com/grafana/loki/pull/3714) **kavirajk**: Fluent-bit git repo link fix 180* [3713](https://github.com/grafana/loki/pull/3713) **cyriltovena**: Add a target to find dead links in our documentation. 181* [3690](https://github.com/grafana/loki/pull/3690) **atxviking**: API Documentation: Fix document links for /loki/api/v1/push example 182* [3655](https://github.com/grafana/loki/pull/3655) **trevorwhitney**: Documentation: add note about wildcard log patterns and log rotation 183* [3648](https://github.com/grafana/loki/pull/3648) **Ruppsn**: Update labels.md in Loki Docs 184* [3647](https://github.com/grafana/loki/pull/3647) **3Xpl0it3r**: fix the promtail-default-config download link in doc 185* [3644](https://github.com/grafana/loki/pull/3644) **periklis**: Add Red Hat to adopters 186* [3633](https://github.com/grafana/loki/pull/3633) **osg-grafana**: Fix wget link. 187* [3596](https://github.com/grafana/loki/pull/3596) **timazet**: documentation: typo correction 188* [3578](https://github.com/grafana/loki/pull/3578) **liguozhong**: [doc] mtric -> metric 189* [3576](https://github.com/grafana/loki/pull/3576) **sergeykranga**: Promtail documentation: fix template example for regexReplaceAll function 190* [3568](https://github.com/grafana/loki/pull/3568) **MichelHollands**: docs: some small docs fixes 191* [3559](https://github.com/grafana/loki/pull/3559) **klausenbusk**: Doc: Remove removed --ingester.recover-from-wal option and fix out-of-date defaults 192* [3555](https://github.com/grafana/loki/pull/3555) **samjewell**: LogQL Docs: Remove key-value pair missing from logfmt output 193* [3552](https://github.com/grafana/loki/pull/3552) **lkokila**: Update README.md 194* [3551](https://github.com/grafana/loki/pull/3551) **cyriltovena**: Fixes doc w/r/t grpc compression. 195* [3542](https://github.com/grafana/loki/pull/3542) **kavirajk**: Remove memberlist config from ring config. 196* [3529](https://github.com/grafana/loki/pull/3529) **Whyeasy**: Added docs for GCP internal labels. 197* [3525](https://github.com/grafana/loki/pull/3525) **robbymilo**: docs: add title to Lambda Promtail 198* [3516](https://github.com/grafana/loki/pull/3516) **cyriltovena**: Fixes broken link in the documentation. 199* [3513](https://github.com/grafana/loki/pull/3513) **owen-d**: fixes broken link 200* [3543](https://github.com/grafana/loki/pull/3543) **owen-d**: compactor docs 201* [3526](https://github.com/grafana/loki/pull/3526) **wardbekker**: Added Architecture Diagram 202* [3518](https://github.com/grafana/loki/pull/3518) **wardbekker**: fix spelling in doc 203* [3503](https://github.com/grafana/loki/pull/3503) **cyriltovena**: Update README.md 204* [3484](https://github.com/grafana/loki/pull/3484) **thomasrockhu**: Add Codecov badge to README 205* [3478](https://github.com/grafana/loki/pull/3478) **chancez**: docs/upgrading: Fix typo 206* [3477](https://github.com/grafana/loki/pull/3477) **slim-bean**: Jsonnet/Docs: update for 2.2 release 207* [3472](https://github.com/grafana/loki/pull/3472) **aronisstav**: Docs: Fix markdown for promtail's output stage 208* [3464](https://github.com/grafana/loki/pull/3464) **camilleryr**: Documentation: Update boltdb-shipper.md to fix typo 209* [3442](https://github.com/grafana/loki/pull/3442) **owen-d**: adds deprecation notice for chunk transfers 210* [3430](https://github.com/grafana/loki/pull/3430) **kavirajk**: doc(gcplog): Add note on scraping multiple GCP projects 211 212#### Promtail 213* [4011](https://github.com/grafana/loki/pull/4011) **dannykopping**: Promtail: adding pipeline stage inspector 214* [4006](https://github.com/grafana/loki/pull/4006) **dannykopping**: Promtail: output timestamp with nanosecond precision in dry-run mode 215* [3971](https://github.com/grafana/loki/pull/3971) **cyriltovena**: Fixes negative gauge in Promtail. 216* [3834](https://github.com/grafana/loki/pull/3834) **trevorwhitney**: Promtail: add consul agent service discovery 217* [3711](https://github.com/grafana/loki/pull/3711) **3Xpl0it3r**: add debug information for extracted data 218* [3683](https://github.com/grafana/loki/pull/3683) **kbudde**: promtail: added timezone to logger in dry-run mode #3679" 219* [3654](https://github.com/grafana/loki/pull/3654) **cyriltovena**: Adds the ability to provide a tripperware to Promtail client. 220* [3587](https://github.com/grafana/loki/pull/3587) **rsteneteg**: Promtail: Remove non-ready filemanager targets 221* [3501](https://github.com/grafana/loki/pull/3501) **kavirajk**: Add unique promtail_instance id to labels for gcptarget 222* [3457](https://github.com/grafana/loki/pull/3457) **nmiculinic**: Promtail: Added path information to deleted tailed file 223* [3400](https://github.com/grafana/loki/pull/3400) **adityacs**: support max_message_length configuration for syslog parser 224 225 226#### Logcli 227* [3879](https://github.com/grafana/loki/pull/3879) **vyzigold**: logcli: Add retries to unsuccessful log queries 228* [3749](https://github.com/grafana/loki/pull/3749) **dbluxo**: logcli: add support for bearer token authentication 229* [3739](https://github.com/grafana/loki/pull/3739) **rsteneteg**: correct logcli instant query timestamp param name 230* [3678](https://github.com/grafana/loki/pull/3678) **cyriltovena**: Add the ability to wrap the roundtripper of the logcli client. 231 232 233#### Build 234* [4034](https://github.com/grafana/loki/pull/4034) **aknuds1**: loki-build-image: Fix building 235* [4028](https://github.com/grafana/loki/pull/4028) **aknuds1**: loki-build-image: Upgrade golangci-lint and Go 236* [4007](https://github.com/grafana/loki/pull/4007) **dannykopping**: Adding @grafana/loki-team as default CODEOWNERS 237* [3997](https://github.com/grafana/loki/pull/3997) **owen-d**: aligns rule path in docker img with bundled config. closes #3952 238* [3950](https://github.com/grafana/loki/pull/3950) **julienduchesne**: Sign drone.yml file 239* [3944](https://github.com/grafana/loki/pull/3944) **jeschkies**: Lint script files. 240* [3941](https://github.com/grafana/loki/pull/3941) **cyriltovena**: Development Docker Compose Setup 241* [3935](https://github.com/grafana/loki/pull/3935) **ecraven**: Makefile: Only set PROMTAIL_CGO if CGO_ENABLED is not 0. 242* [3832](https://github.com/grafana/loki/pull/3832) **julienduchesne**: Add step to identify windows Drone runner 243* [3731](https://github.com/grafana/loki/pull/3731) **cyriltovena**: Fix website branch to trigger update. 244* [3708](https://github.com/grafana/loki/pull/3708) **julienduchesne**: Deploy loki with Drone plugin instead of CircleCI job 245* [3703](https://github.com/grafana/loki/pull/3703) **darkn3rd**: Update docker.md for 2.2.1 246* [3625](https://github.com/grafana/loki/pull/3625) **slim-bean**: Build: Update CI for branch rename to main 247* [3624](https://github.com/grafana/loki/pull/3624) **slim-bean**: Build: Fix drone dependencies on manifest step 248* [3615](https://github.com/grafana/loki/pull/3615) **slim-bean**: Remove codecov 249* [3481](https://github.com/grafana/loki/pull/3481) **slim-bean**: Update Go and Alpine versions 250 251 252#### Jsonnet 253* [4030](https://github.com/grafana/loki/pull/4030) **cyriltovena**: Improve the sweep lag panel in the retention dashboard. 254* [3917](https://github.com/grafana/loki/pull/3917) **jvrplmlmn**: refactor(production/ksonnet): Remove kausal from the root element 255* [3893](https://github.com/grafana/loki/pull/3893) **sandeepsukhani**: update uid of loki-deletion dashboard 256* [3891](https://github.com/grafana/loki/pull/3891) **sandeepsukhani**: add index-gateway to reads and reads-resources dashboards 257* [3877](https://github.com/grafana/loki/pull/3877) **sandeepsukhani**: Fix jsonnet for index-gateway 258* [3854](https://github.com/grafana/loki/pull/3854) **cyriltovena**: Fixes Loki reads dashboard. 259* [3848](https://github.com/grafana/loki/pull/3848) **kavirajk**: Add explicit `main` to pull loki and promtail to install it via Tanka 260* [3794](https://github.com/grafana/loki/pull/3794) **sandeepsukhani**: add a dashboard for log deletion requests in loki 261* [3697](https://github.com/grafana/loki/pull/3697) **owen-d**: better operational dashboard annotations via diff logger 262* [3658](https://github.com/grafana/loki/pull/3658) **cyriltovena**: Add a dashboard for retention to the loki-mixin. 263* [3601](https://github.com/grafana/loki/pull/3601) **owen-d**: Dashboard/fix operational vars 264* [3584](https://github.com/grafana/loki/pull/3584) **sandeepsukhani**: add loki resource usage dashboard for read and write path 265 266#### Project 267* [3963](https://github.com/grafana/loki/pull/3963) **rfratto**: Remove Robert Fratto from list of team members 268** [3926](https://github.com/grafana/loki/pull/3926) **cyriltovena**: Add Danny Kopping to the Loki Team. 269* [3732](https://github.com/grafana/loki/pull/3732) **dannykopping**: Issue Templates: Improve wording and add warnings 270* [3722](https://github.com/grafana/loki/pull/3722) **oddlittlebird**: Update CODEOWNERS 271* [3951](https://github.com/grafana/loki/pull/3951) **owen-d**: update sizing calc 272* [3931](https://github.com/grafana/loki/pull/3931) **owen-d**: Hackathon/cluster 273* [3920](https://github.com/grafana/loki/pull/3920) **owen-d**: adds replication & deduping into cost 274** [3630](https://github.com/grafana/loki/pull/3630) **slim-bean**: Re-license to AGPLv3 275 276#### Docker-driver 277* [3814](https://github.com/grafana/loki/pull/3814) **kavirajk**: Update the docker-driver doc about default labels 278* [3727](https://github.com/grafana/loki/pull/3727) **3Xpl0it3r**: docker-driver: remove duplicated code 279** [3709](https://github.com/grafana/loki/pull/3709) **cyriltovena**: Fixes docker driver that would panic when closed. 280 281### Notes 282 283This release was created from revision 8012362674568379a3871ff8c4a2bfd1ddba7ad1 (Which was PR 3460) 284 285### Dependencies 286 287* Go Version: 1.16.2 288* Cortex Version: 485474c9afb2614fb89af3f48803c37d016bbaed 289 290## 2.2.1 (2021/04/05) 291 2922.2.1 fixes several important bugs, it is recommended everyone running 2.2.0 upgrade to 2.2.1 293 2942.2.1 also adds the `labelallow` pipeline stage in Promtail which lets an allowlist be created for what labels will be sent by Promtail to Loki. 295 296* [3468](https://github.com/grafana/loki/pull/3468) **adityacs**: Support labelallow stage in Promtail 297* [3502](https://github.com/grafana/loki/pull/3502) **cyriltovena**: Fixes a bug where unpack would mutate log line. 298* [3540](https://github.com/grafana/loki/pull/3540) **cyriltovena**: Support for single step metric query. 299* [3550](https://github.com/grafana/loki/pull/3550) **cyriltovena**: Fixes a bug in MatrixStepper when sharding queries. 300* [3566](https://github.com/grafana/loki/pull/3566) **cyriltovena**: Properly release the ticker in Loki client. 301* [3573](https://github.com/grafana/loki/pull/3573) **cyriltovena**: Fixes a race when using specific tenant and multi-client. 302 303## 2.2.0 (2021/03/10) 304 305With over 200 PR's 2.2 includes significant features, performance improvements, and bug fixes! 306 307The most upvoted issue for Loki was closed in this release! [Issue 74](https://github.com/grafana/loki/issues/74) requesting support for handling multi-line logs in Promtail was implemented in [PR 3024](https://github.com/grafana/loki/pull/3024). Thanks @jeschkies! 308 309Other exciting news for Promtail, [PR 3246](https://github.com/grafana/loki/pull/3246) by @cyriltovena introduces support for reading Windows Events! 310 311Switching to Loki, @owen-d has added a write ahead log to Loki! [PR 2981](https://github.com/grafana/loki/pull/2981) was the first of many as we have spent the last several months using and abusing our write ahead logs to flush out any bugs! 312 313A significant number of the PR's in this release have gone to improving the features introduced in Loki 2.0. @cyriltovena overhauled the JSON parser in [PR 3163](https://github.com/grafana/loki/pull/3163) (and a few other PR's), to provide both a faster and smarter parsing to only extract JSON content which is used in the query output. The newest Loki squad member @dannykopping fine tuned the JSON parser options in [PR 3280](https://github.com/grafana/loki/pull/3280) allowing you to specific individual JSON elements, including support now for accessing elements in an array. Many, many other additional improvements have been made, as well as several fixes to the new LogQL features added some months ago, this upgrade should have everyone seeing improvements in their queries. 314 315@cyriltovena also set his PPROF skills loose on the Loki write path which resulted in about 8x less memory usage on our distributors and a much more stable memory usage when ingesters are flushing a lot of chunks at the same time. 316 317There are many other noteworthy additions and fixes, too many to list, but we should call out one more feature all you Google Cloud Platform users might be excited about: in [PR 3083](https://github.com/grafana/loki/pull/3083) @kavirajk added support to Promtail for listening on Google Pub/Sub topics, letting you setup log sinks for your GCP logs to be ingested by Promtail and sent to Loki! 318 319Thanks to everyone for another exciting Loki release!! 320 321Please read the [Upgrade Guide](https://github.com/grafana/loki/blob/master/docs/sources/upgrading/_index.md#220) before upgrading for a smooth experience. 322 323TL;DR Loki 2.2 changes the internal chunk format which limits what versions you can downgrade to, a bug in how many queries were allowed to be scheduled per tenant was fixed which might affect your `max_query_parallelism` and `max_outstanding_per_tenant` settings, and we fixed a mistake related `scrape_configs` which do not have a `pipeline_stages` defined. If you have any Promtail `scrape_configs` which do not specify `pipeline_stages` you should go read the upgrade notes! 324 325### All Changes 326 327#### Loki 328 329* [3460](https://github.com/grafana/loki/pull/3460) **slim-bean**: Loki: Per Tenant Runtime Configs 330* [3459](https://github.com/grafana/loki/pull/3459) **cyriltovena**: Fixes split interval for metrics queries. 331* [3432](https://github.com/grafana/loki/pull/3432) **slim-bean**: Loki: change ReadStringAsSlice to ReadString so it doesn't parse quotes inside the packed _entry 332* [3429](https://github.com/grafana/loki/pull/3429) **cyriltovena**: Improve the parser hint tests. 333* [3426](https://github.com/grafana/loki/pull/3426) **cyriltovena**: Only unpack entry if the key `_entry` exist. 334* [3424](https://github.com/grafana/loki/pull/3424) **cyriltovena**: Add fgprof to Loki and Promtail. 335* [3423](https://github.com/grafana/loki/pull/3423) **cyriltovena**: Add limit and line_returned in the query log. 336* [3420](https://github.com/grafana/loki/pull/3420) **cyriltovena**: Introduce a unpack parser. 337* [3417](https://github.com/grafana/loki/pull/3417) **cyriltovena**: Fixes a race in the scheduling limits. 338* [3416](https://github.com/grafana/loki/pull/3416) **ukolovda**: Distributor: append several tests for HTTP parser. 339* [3411](https://github.com/grafana/loki/pull/3411) **slim-bean**: Loki: fix alignment of atomic 64 bit to work with 32 bit OS 340* [3409](https://github.com/grafana/loki/pull/3409) **gotjosh**: Instrumentation: Add histogram for request duration on gRPC client to Ingesters 341* [3408](https://github.com/grafana/loki/pull/3408) **jgehrcke**: distributor: fix snappy-compressed protobuf POST request handling (#3407) 342* [3388](https://github.com/grafana/loki/pull/3388) **owen-d**: prevents duplicate log lines from being replayed. closes #3378 343* [3383](https://github.com/grafana/loki/pull/3383) **cyriltovena**: Fixes head chunk iterator direction. 344* [3380](https://github.com/grafana/loki/pull/3380) **slim-bean**: Loki: Fix parser hint for extracted labels which collide with stream labels 345* [3372](https://github.com/grafana/loki/pull/3372) **cyriltovena**: Fixes a panic with whitespace key. 346* [3350](https://github.com/grafana/loki/pull/3350) **cyriltovena**: Fixes ingester stats. 347* [3348](https://github.com/grafana/loki/pull/3348) **cyriltovena**: Fixes 500 in the querier when returning multiple errors. 348* [3347](https://github.com/grafana/loki/pull/3347) **cyriltovena**: Fixes a tight loop in the Engine with LogQL parser. 349* [3344](https://github.com/grafana/loki/pull/3344) **cyriltovena**: Fixes some 500 returned by querier when storage cancellation happens. 350* [3342](https://github.com/grafana/loki/pull/3342) **cyriltovena**: Bound parallelism frontend 351* [3340](https://github.com/grafana/loki/pull/3340) **owen-d**: Adds some flushing instrumentation/logs 352* [3339](https://github.com/grafana/loki/pull/3339) **owen-d**: adds Start() method to WAL interface to delay checkpointing until aft… 353* [3338](https://github.com/grafana/loki/pull/3338) **sandeepsukhani**: dedupe index on all the queries for a table instead of query batches 354* [3326](https://github.com/grafana/loki/pull/3326) **owen-d**: removes wal recover flag 355* [3307](https://github.com/grafana/loki/pull/3307) **slim-bean**: Loki: fix validation error and metrics 356* [3306](https://github.com/grafana/loki/pull/3306) **cyriltovena**: Add finalizer to zstd. 357* [3300](https://github.com/grafana/loki/pull/3300) **sandeepsukhani**: increase db retain period in ingesters to cover index cache validity period as well 358* [3299](https://github.com/grafana/loki/pull/3299) **owen-d**: Logql/absent label optimization 359* [3295](https://github.com/grafana/loki/pull/3295) **jtlisi**: chore: update cortex to latest and fix refs 360* [3291](https://github.com/grafana/loki/pull/3291) **ukolovda**: Distributor: Loki API can receive gzipped JSON 361* [3280](https://github.com/grafana/loki/pull/3280) **dannykopping**: LogQL: Simple JSON expressions 362* [3279](https://github.com/grafana/loki/pull/3279) **cyriltovena**: Fixes logfmt parser hints. 363* [3278](https://github.com/grafana/loki/pull/3278) **owen-d**: Testware/ rate-unwrap-multi 364* [3274](https://github.com/grafana/loki/pull/3274) **liguozhong**: [ingester_query] change var "clients" to "reps" 365* [3267](https://github.com/grafana/loki/pull/3267) **jeschkies**: Update vendored Cortex to 0976147451ee 366* [3263](https://github.com/grafana/loki/pull/3263) **cyriltovena**: Fix a bug with metric queries and label_format. 367* [3261](https://github.com/grafana/loki/pull/3261) **sandeepsukhani**: fix broken json logs push path 368* [3256](https://github.com/grafana/loki/pull/3256) **jtlisi**: update vendored cortex and add new replace overrides 369* [3251](https://github.com/grafana/loki/pull/3251) **cyriltovena**: Ensure we have parentheses for bin ops. 370* [3249](https://github.com/grafana/loki/pull/3249) **cyriltovena**: Fixes a bug where slice of Entries where not zeroed 371* [3241](https://github.com/grafana/loki/pull/3241) **cyriltovena**: Allocate entries array with correct size while decoding WAL entries. 372* [3237](https://github.com/grafana/loki/pull/3237) **cyriltovena**: Fixes unmarshalling of tailing responses. 373* [3236](https://github.com/grafana/loki/pull/3236) **slim-bean**: Loki: Log a crude lag metric for how far behind a client is. 374* [3234](https://github.com/grafana/loki/pull/3234) **cyriltovena**: Fixes previous commit not using the new sized body. 375* [3233](https://github.com/grafana/loki/pull/3233) **cyriltovena**: Re-introduce https://github.com/grafana/loki/pull/3178. 376* [3228](https://github.com/grafana/loki/pull/3228) **MichelHollands**: Add config endpoint 377* [3218](https://github.com/grafana/loki/pull/3218) **owen-d**: WAL backpressure 378* [3217](https://github.com/grafana/loki/pull/3217) **cyriltovena**: Rename checkpoint proto package to avoid conflict with cortex. 379* [3215](https://github.com/grafana/loki/pull/3215) **cyriltovena**: Cortex update pre 1.7 380* [3211](https://github.com/grafana/loki/pull/3211) **cyriltovena**: Fixes tail api marshalling for v1. 381* [3210](https://github.com/grafana/loki/pull/3210) **cyriltovena**: Reverts flush buffer pooling. 382* [3201](https://github.com/grafana/loki/pull/3201) **sandeepsukhani**: limit query range in async store for ingesters when query-ingesters-within flag is set 383* [3200](https://github.com/grafana/loki/pull/3200) **cyriltovena**: Improve ingester flush memory usage. 384* [3195](https://github.com/grafana/loki/pull/3195) **owen-d**: Ignore flushed chunks during checkpointing 385* [3194](https://github.com/grafana/loki/pull/3194) **cyriltovena**: Fixes unwrap expressions from last optimization. 386* [3193](https://github.com/grafana/loki/pull/3193) **cyriltovena**: Improve checkpoint series iterator. 387* [3188](https://github.com/grafana/loki/pull/3188) **cyriltovena**: Improves checkpointerWriter memory usage 388* [3180](https://github.com/grafana/loki/pull/3180) **owen-d**: moves boltdb flags to config file 389* [3178](https://github.com/grafana/loki/pull/3178) **cyriltovena**: Logs PushRequest data. 390* [3163](https://github.com/grafana/loki/pull/3163) **cyriltovena**: Uses custom json-iter decoder for log entries. 391* [3159](https://github.com/grafana/loki/pull/3159) **MichelHollands**: Make httpAuthMiddleware field public 392* [3153](https://github.com/grafana/loki/pull/3153) **cyriltovena**: Improve wal entries encoding. 393* [3152](https://github.com/grafana/loki/pull/3152) **AllenzhLi**: update github.com/gorilla/websocket to fixes a potential denial-of-service (DoS) vector 394* [3146](https://github.com/grafana/loki/pull/3146) **owen-d**: More semantically correct flush shutdown 395* [3143](https://github.com/grafana/loki/pull/3143) **cyriltovena**: Fixes absent_over_time to work with all log selector. 396* [3141](https://github.com/grafana/loki/pull/3141) **owen-d**: Swaps mutex for atomic in ingester's OnceSwitch 397* [3137](https://github.com/grafana/loki/pull/3137) **owen-d**: label_format no longer shardable and introduces the Shardable() metho… 398* [3136](https://github.com/grafana/loki/pull/3136) **owen-d**: Don't fail writes due to full WAL disk 399* [3134](https://github.com/grafana/loki/pull/3134) **cyriltovena**: Improve distributors validation and apply in-place filtering. 400* [3132](https://github.com/grafana/loki/pull/3132) **owen-d**: Integrates label replace into sharding code 401* [3131](https://github.com/grafana/loki/pull/3131) **MichelHollands**: Update cortex to 1 6 402* [3126](https://github.com/grafana/loki/pull/3126) **dannykopping**: Implementing line comments 403* [3122](https://github.com/grafana/loki/pull/3122) **owen-d**: Self documenting pipeline process interface 404* [3117](https://github.com/grafana/loki/pull/3117) **owen-d**: Wal/recover corruption 405* [3114](https://github.com/grafana/loki/pull/3114) **owen-d**: Disables the stream limiter until wal has recovered 406* [3092](https://github.com/grafana/loki/pull/3092) **liguozhong**: lru cache logql.ParseLabels 407* [3090](https://github.com/grafana/loki/pull/3090) **cyriltovena**: Improve tailer matching by using the index. 408* [3087](https://github.com/grafana/loki/pull/3087) **MichelHollands**: feature: make server publicly available 409* [3080](https://github.com/grafana/loki/pull/3080) **cyriltovena**: Improve JSON parser and add labels parser hints. 410* [3077](https://github.com/grafana/loki/pull/3077) **MichelHollands**: Make the moduleManager field public 411* [3065](https://github.com/grafana/loki/pull/3065) **cyriltovena**: Optimizes SampleExpr to remove unnecessary line_format. 412* [3064](https://github.com/grafana/loki/pull/3064) **cyriltovena**: Add zstd and flate compressions algorithms. 413* [3053](https://github.com/grafana/loki/pull/3053) **cyriltovena**: Add absent_over_time 414* [3048](https://github.com/grafana/loki/pull/3048) **cyriltovena**: Support rate for unwrapped expressions. 415* [3047](https://github.com/grafana/loki/pull/3047) **cyriltovena**: Add function label_replace. 416* [3030](https://github.com/grafana/loki/pull/3030) **cyriltovena**: Allows by/without to be empty and available for max/min_over_time 417* [3025](https://github.com/grafana/loki/pull/3025) **cyriltovena**: Fixes a swallowed context err in the batch storage. 418* [3013](https://github.com/grafana/loki/pull/3013) **owen-d**: headblock checkpointing up to v3 419* [3008](https://github.com/grafana/loki/pull/3008) **cyriltovena**: Fixes the ruler storage with the boltdb store. 420* [3000](https://github.com/grafana/loki/pull/3000) **owen-d**: Introduces per stream chunks mutex 421* [2981](https://github.com/grafana/loki/pull/2981) **owen-d**: Adds WAL support (experimental) 422* [2960](https://github.com/grafana/loki/pull/2960) **sandeepsukhani**: fix table deletion in table client for boltdb-shipper 423 424#### Promtail 425 426* [3422](https://github.com/grafana/loki/pull/3422) **kavirajk**: Modify script to accept inclusion and exclustion filters as variables 427* [3404](https://github.com/grafana/loki/pull/3404) **dannykopping**: Remove default docker pipeline stage 428* [3401](https://github.com/grafana/loki/pull/3401) **slim-bean**: Promtail: Add pack stage 429* [3381](https://github.com/grafana/loki/pull/3381) **adityacs**: fix nested captured groups indexing in replace stage 430* [3332](https://github.com/grafana/loki/pull/3332) **cyriltovena**: Embed timezone data in Promtail. 431* [3304](https://github.com/grafana/loki/pull/3304) **kavirajk**: Use project-id from the variables. Remove hardcoding 432* [3303](https://github.com/grafana/loki/pull/3303) **cyriltovena**: Increase the windows bookmark buffer. 433* [3302](https://github.com/grafana/loki/pull/3302) **cyriltovena**: Fixes races in multiline stage and promtail. 434* [3298](https://github.com/grafana/loki/pull/3298) **gregorybrzeski**: Promtail: fix typo in config variable name - BookmarkPath 435* [3285](https://github.com/grafana/loki/pull/3285) **kavirajk**: Make incoming labels from gcp into Loki internal labels. 436* [3284](https://github.com/grafana/loki/pull/3284) **kavirajk**: Avoid putting all the GCP labels into loki labels 437* [3246](https://github.com/grafana/loki/pull/3246) **cyriltovena**: Windows events 438* [3224](https://github.com/grafana/loki/pull/3224) **veltmanj**: Fix(pkg/promtail) CVE-2020-11022 JQuery vulnerability 439* [3207](https://github.com/grafana/loki/pull/3207) **cyriltovena**: Fixes panic when using multiple clients 440* [3191](https://github.com/grafana/loki/pull/3191) **rfratto**: promtail: pass registerer to gcplog 441* [3175](https://github.com/grafana/loki/pull/3175) **rfratto**: Promtail: pass a prometheus registerer to promtail components 442* [3083](https://github.com/grafana/loki/pull/3083) **kavirajk**: Gcplog targetmanager 443* [3024](https://github.com/grafana/loki/pull/3024) **jeschkies**: Collapse multiline logs based on a start line. 444* [3015](https://github.com/grafana/loki/pull/3015) **cyriltovena**: Add more information about why a tailer would stop. 445* [2996](https://github.com/grafana/loki/pull/2996) **cyriltovena**: Asynchronous Promtail stages 446* [2898](https://github.com/grafana/loki/pull/2898) **kavirajk**: fix(docker-driver): Propagate promtail's `client.Stop` properly 447 448#### Logcli 449 450* [3325](https://github.com/grafana/loki/pull/3325) **cyriltovena**: Fixes step encoding in logcli. 451* [3271](https://github.com/grafana/loki/pull/3271) **chancez**: Refactor logcli Client interface to use time objects for LiveTailQueryConn 452* [3270](https://github.com/grafana/loki/pull/3270) **chancez**: logcli: Fix handling of logcli query using --since/--from and --tail 453* [3229](https://github.com/grafana/loki/pull/3229) **dethi**: logcli: support --include-label when not using --tail 454 455 456#### Jsonnet 457 458* [3447](https://github.com/grafana/loki/pull/3447) **owen-d**: Use better memory metric on operational dashboard 459* [3439](https://github.com/grafana/loki/pull/3439) **owen-d**: simplifies jsonnet sharding 460* [3357](https://github.com/grafana/loki/pull/3357) **owen-d**: Libsonnet/better sharding parallelism defaults 461* [3356](https://github.com/grafana/loki/pull/3356) **owen-d**: removes sharding queue math after global concurrency PR 462* [3329](https://github.com/grafana/loki/pull/3329) **sandeepsukhani**: fix config for statefulset rulers when using boltdb-shipper 463* [3297](https://github.com/grafana/loki/pull/3297) **owen-d**: adds stateful ruler clause for boltdb shipper jsonnet 464* [3254](https://github.com/grafana/loki/pull/3254) **hairyhenderson**: ksonnet: Remove invalid hostname from default promtail configuration 465* [3181](https://github.com/grafana/loki/pull/3181) **owen-d**: remaining sts use parallel mgmt policy 466* [3179](https://github.com/grafana/loki/pull/3179) **owen-d**: Ruler statefulsets 467* [3156](https://github.com/grafana/loki/pull/3156) **slim-bean**: Jsonnet: Changes ingester PVC from 5Gi to 10Gi 468* [3139](https://github.com/grafana/loki/pull/3139) **owen-d**: Less confusing jsonnet error message when using boltdb shipper defaults. 469* [3079](https://github.com/grafana/loki/pull/3079) **rajatvig**: Fix ingester PVC data declaration to use configured value 470* [3074](https://github.com/grafana/loki/pull/3074) **c0ffeec0der**: Ksonnet: Assign appropriate pvc size and class to compactor and ingester 471* [3062](https://github.com/grafana/loki/pull/3062) **cyriltovena**: Remove regexes in the operational dashboard. 472* [3014](https://github.com/grafana/loki/pull/3014) **owen-d**: loki wal libsonnet 473* [3010](https://github.com/grafana/loki/pull/3010) **cyriltovena**: Fixes promtail mixin dashboard. 474 475#### fluentd 476 477* [3358](https://github.com/grafana/loki/pull/3358) **fpob**: Fix fluentd plugin when kubernetes labels were missing 478 479#### fluent bit 480 481* [3240](https://github.com/grafana/loki/pull/3240) **sbaier1**: fix fluent-bit output plugin generating invalid JSON 482 483 484#### Docker Logging Driver 485 486* [3331](https://github.com/grafana/loki/pull/3331) **cyriltovena**: Add pprof endpoint to docker-driver. 487* [3225](https://github.com/grafana/loki/pull/3225) **Le0tk0k**: (fix: cmd/docker-driver): Insert a space in the error message 488 489#### Docs 490 491* [3437](https://github.com/grafana/loki/pull/3437) **caleb15**: docs: add note about regex 492* [3421](https://github.com/grafana/loki/pull/3421) **kavirajk**: doc(gcplog): Advanced log export filter example 493* [3419](https://github.com/grafana/loki/pull/3419) **suitupalex**: docs: promtail: Fix typo w/ windows_events hyperlink. 494* [3418](https://github.com/grafana/loki/pull/3418) **dannykopping**: Adding upgrade documentation for promtail pipeline_stages change 495* [3385](https://github.com/grafana/loki/pull/3385) **paaacman**: Documentation: enable environment variable in configuration 496* [3373](https://github.com/grafana/loki/pull/3373) **StMarian**: Documentation: Fix configuration description 497* [3371](https://github.com/grafana/loki/pull/3371) **owen-d**: Distributor overview docs 498* [3370](https://github.com/grafana/loki/pull/3370) **tkowalcz**: documentation: Add Tjahzi to the list of unofficial clients 499* [3352](https://github.com/grafana/loki/pull/3352) **kavirajk**: Remove extra space between broken link 500* [3351](https://github.com/grafana/loki/pull/3351) **kavirajk**: Add some operation details to gcplog doc 501* [3316](https://github.com/grafana/loki/pull/3316) **kavirajk**: docs(fix): Make best practices docs look better 502* [3292](https://github.com/grafana/loki/pull/3292) **wapmorgan**: Patch 2 - fix link to another documentation files 503* [3265](https://github.com/grafana/loki/pull/3265) **sandeepsukhani**: Boltdb shipper doc fixes 504* [3239](https://github.com/grafana/loki/pull/3239) **owen-d**: updates tanka installation docs 505* [3235](https://github.com/grafana/loki/pull/3235) **scoof**: docs: point to latest release for docker installation 506* [3220](https://github.com/grafana/loki/pull/3220) **liguozhong**: [doc] fix err. "loki_frontend" is invalid 507* [3212](https://github.com/grafana/loki/pull/3212) **nvtkaszpir**: Fix: Update docs for logcli 508* [3190](https://github.com/grafana/loki/pull/3190) **kavirajk**: doc(gcplog): Fix titles for Cloud provisioning for GCP logs 509* [3165](https://github.com/grafana/loki/pull/3165) **liguozhong**: [doc] fix:querier do not handle "/flush" api 510* [3164](https://github.com/grafana/loki/pull/3164) **owen-d**: updates alerting docs post 2.0 511* [3162](https://github.com/grafana/loki/pull/3162) **huikang**: Doc: Add missing wal in configuration 512* [3148](https://github.com/grafana/loki/pull/3148) **huikang**: Doc: add missing type supported by table manager 513* [3147](https://github.com/grafana/loki/pull/3147) **marionxue**: Markdown Code highlighting 514* [3138](https://github.com/grafana/loki/pull/3138) **jeschkies**: Give another example for multiline. 515* [3128](https://github.com/grafana/loki/pull/3128) **cyriltovena**: Fixes LogQL documentation links. 516* [3124](https://github.com/grafana/loki/pull/3124) **wujie1993**: fix time duration unit 517* [3123](https://github.com/grafana/loki/pull/3123) **scoren-gl**: Update getting-in-touch.md 518* [3115](https://github.com/grafana/loki/pull/3115) **valmack**: Docs: Include instruction to enable variable expansion 519* [3109](https://github.com/grafana/loki/pull/3109) **nileshcs**: Documentation fix for downstream_url 520* [3102](https://github.com/grafana/loki/pull/3102) **slim-bean**: Docs: Changelog: fix indentation and add helm repo url 521* [3094](https://github.com/grafana/loki/pull/3094) **benjaminhuo**: Fix storage guide links 522* [3088](https://github.com/grafana/loki/pull/3088) **cyriltovena**: Small fixes for the documentation. 523* [3084](https://github.com/grafana/loki/pull/3084) **ilpianista**: Update reference to old helm chart repo 524* [3078](https://github.com/grafana/loki/pull/3078) **kavirajk**: mention the use of `config.expand-env` flag in the doc. 525* [3049](https://github.com/grafana/loki/pull/3049) **vitalets**: [Docs] Clarify docker-driver configuration options 526* [3039](https://github.com/grafana/loki/pull/3039) **jdbaldry**: doc: logql formatting fixes 527* [3035](https://github.com/grafana/loki/pull/3035) **unguiculus**: Fix multiline docs 528* [3033](https://github.com/grafana/loki/pull/3033) **RichiH**: docs: Create ADOPTERS.md 529* [3032](https://github.com/grafana/loki/pull/3032) **oddlittlebird**: Docs: Update _index.md 530* [3029](https://github.com/grafana/loki/pull/3029) **jeschkies**: Correct `multiline` documentation. 531* [3027](https://github.com/grafana/loki/pull/3027) **nop33**: Fix docs header inconsistency 532* [3026](https://github.com/grafana/loki/pull/3026) **owen-d**: wal docs 533* [3017](https://github.com/grafana/loki/pull/3017) **jdbaldry**: doc: Cleanup formatting 534* [3009](https://github.com/grafana/loki/pull/3009) **jdbaldry**: doc: Fix query-frontend typo 535* [3002](https://github.com/grafana/loki/pull/3002) **keyolk**: Fix typo 536* [2991](https://github.com/grafana/loki/pull/2991) **jontg**: Documentation: Add a missing field to the extended config s3 example 537* [2956](https://github.com/grafana/loki/pull/2956) **owen-d**: Updates chunkenc doc for V3 538 539#### Build 540 541* [3412](https://github.com/grafana/loki/pull/3412) **rfratto**: Remove unneeded prune-ci-tags drone job 542* [3390](https://github.com/grafana/loki/pull/3390) **wardbekker**: Don't auto-include pod labels as loki labels as a sane default 543* [3321](https://github.com/grafana/loki/pull/3321) **owen-d**: defaults promtail to 2.1.0 in install script 544* [3277](https://github.com/grafana/loki/pull/3277) **kavirajk**: Add step to version Loki docs during public release process. 545* [3243](https://github.com/grafana/loki/pull/3243) **chancez**: dist: Build promtail for windows/386 to support 32 bit windows hosts 546* [3206](https://github.com/grafana/loki/pull/3206) **kavirajk**: Terraform script to automate GCP provisioning for gcplog 547* [3149](https://github.com/grafana/loki/pull/3149) **jlosito**: Allow dependabot to keep github actions up-to-date 548* [3072](https://github.com/grafana/loki/pull/3072) **slim-bean**: Helm: Disable CI 549* [3031](https://github.com/grafana/loki/pull/3031) **AdamKorcz**: Testing: Introduced continuous fuzzing 550* [3006](https://github.com/grafana/loki/pull/3006) **huikang**: Fix the docker image version in compose deployment 551 552 553#### Tooling 554 555* [3377](https://github.com/grafana/loki/pull/3377) **slim-bean**: Tooling: Update chunks-inspect to understand the new chunk format as well as new compression algorithms 556* [3151](https://github.com/grafana/loki/pull/3151) **slim-bean**: Loki migrate-tool 557 558 559### Notes 560 561This release was created from revision 8012362674568379a3871ff8c4a2bfd1ddba7ad1 (Which was PR 3460) 562 563### Dependencies 564 565* Go Version: 1.15.3 566* Cortex Version: 7dac81171c665be071bd167becd1f55528a9db32 567 568 569## 2.1.0 (2020/12/23) 570 571Happy Holidays from the Loki team! Please enjoy a new Loki release to welcome in the New Year! 572 5732.1.0 Contains a number of fixes, performance improvements and enhancements to the 2.0.0 release! 574 575### Notable changes 576 577#### Helm users read this! 578 579The Helm charts have moved! 580 581* [2720](https://github.com/grafana/loki/pull/2720) **torstenwalter**: Deprecate Charts as they have been moved 582 583This was done to consolidate Grafana's helm charts for all Grafana projects in one place: https://github.com/grafana/helm-charts/ 584 585**From now moving forward, please use the new Helm repo url: https://grafana.github.io/helm-charts** 586 587The charts in the Loki repo will soon be removed so please update your Helm repo to the new URL and submit your PR's over there as well 588 589Special thanks to @torstenwalter, @unguiculus, and @scottrigby for their initiative and amazing work to make this happen! 590 591Also go check out the microservices helm chart contributed by @unguiculus in the new repo! 592 593#### Fluent bit plugin users read this! 594 595Fluent bit officially supports Loki as an output plugin now! WoooHOOO! 596 597However this created a naming conflict with our existing output plugin (the new native output uses the name `loki`) so we have renamed our plugin. 598 599* [2974](https://github.com/grafana/loki/pull/2974) **hedss**: fluent-bit: Rename Fluent Bit plugin output name. 600 601In time our plan is to deprecate and eliminate our output plugin in favor of the native Loki support. However until then you can continue using the plugin with the following change: 602 603Old: 604 605``` 606[Output] 607 Name loki 608``` 609 610New: 611 612``` 613[Output] 614 Name grafana-loki 615``` 616 617#### Fixes 618 619A lot of work went into 2.0 with a lot of new code and rewrites to existing, this introduced and uncovered some bugs which are fixed in 2.1: 620 621* [2807](https://github.com/grafana/loki/pull/2807) **cyriltovena**: Fix error swallowed in the frontend. 622* [2805](https://github.com/grafana/loki/pull/2805) **cyriltovena**: Improve pipeline stages ast errors. 623* [2824](https://github.com/grafana/loki/pull/2824) **owen-d**: Fix/validate compactor config 624* [2830](https://github.com/grafana/loki/pull/2830) **sandeepsukhani**: fix panic in ingester when not running with boltdb shipper while queriers does 625* [2850](https://github.com/grafana/loki/pull/2850) **owen-d**: Only applies entry limits to non-SampleExprs. 626* [2855](https://github.com/grafana/loki/pull/2855) **sandeepsukhani**: fix query intervals when running boltdb-shipper in single binary 627* [2895](https://github.com/grafana/loki/pull/2895) **shokada**: Fix error 'Unexpected: ("$", "$") while parsing field definition' 628* [2902](https://github.com/grafana/loki/pull/2902) **cyriltovena**: Fixes metric query issue with no grouping. 629* [2901](https://github.com/grafana/loki/pull/2901) **cyriltovena**: Fixes a panic with the logql.NoopPipeline. 630* [2913](https://github.com/grafana/loki/pull/2913) **cyriltovena**: Fixes logql.QueryType. 631* [2917](https://github.com/grafana/loki/pull/2917) **cyriltovena**: Fixes race condition in tailer since logql v2. 632* [2960](https://github.com/grafana/loki/pull/2960) **sandeepsukhani**: fix table deletion in table client for boltdb-shipper 633 634#### Enhancements 635 636A number of performance and resource improvements have been made as well! 637 638* [2911](https://github.com/grafana/loki/pull/2911) **sandeepsukhani**: Boltdb shipper query readiness 639* [2875](https://github.com/grafana/loki/pull/2875) **cyriltovena**: Labels computation LogQLv2 640* [2927](https://github.com/grafana/loki/pull/2927) **cyriltovena**: Improve logql parser allocations. 641* [2926](https://github.com/grafana/loki/pull/2926) **cyriltovena**: Cache label strings in ingester to improve memory usage. 642* [2931](https://github.com/grafana/loki/pull/2931) **cyriltovena**: Only append tailed entries if needed. 643* [2973](https://github.com/grafana/loki/pull/2973) **cyriltovena**: Avoid parsing labels when tailer is sending from a stream. 644* [2959](https://github.com/grafana/loki/pull/2959) **cyriltovena**: Improve tailer matcher function. 645* [2876](https://github.com/grafana/loki/pull/2876) **jkellerer**: LogQL: Add unwrap bytes() conversion function 646 647 648#### Notable mentions 649 650Thanks to @timbyr for adding an often requested feature, the ability to support environment variable expansion in config files! 651 652* [2837](https://github.com/grafana/loki/pull/2837) **timbyr**: Configuration: Support environment expansion in configuration 653 654Thanks to @huikang for adding a new docker-compose file for running Loki as microservices! 655 656* [2740](https://github.com/grafana/loki/pull/2740) **huikang**: Deploy: add docker-compose cluster deployment file 657 658### All Changes 659 660#### Loki 661* [2988](https://github.com/grafana/loki/pull/2988) **slim-bean**: Loki: handle faults when opening boltdb files 662* [2984](https://github.com/grafana/loki/pull/2984) **owen-d**: adds the ability to read chunkFormatV3 while writing v2 663* [2983](https://github.com/grafana/loki/pull/2983) **slim-bean**: Loki: recover from panic opening boltdb files 664* [2975](https://github.com/grafana/loki/pull/2975) **cyriltovena**: Fixes vector grouping injection. 665* [2972](https://github.com/grafana/loki/pull/2972) **cyriltovena**: Add ProcessString to Pipeline. 666* [2962](https://github.com/grafana/loki/pull/2962) **cyriltovena**: Implement io.WriteTo by chunks. 667* [2951](https://github.com/grafana/loki/pull/2951) **owen-d**: bumps rules-action ref to logqlv2+ version 668* [2946](https://github.com/grafana/loki/pull/2946) **cyriltovena**: Fixes the Stringer of the byte label operator. 669* [2945](https://github.com/grafana/loki/pull/2945) **cyriltovena**: Fixes iota unexpected behaviour with bytes for chunk encoding. 670* [2941](https://github.com/grafana/loki/pull/2941) **jeschkies**: Test label filter for bytes. 671* [2934](https://github.com/grafana/loki/pull/2934) **owen-d**: chunk schema v3 672* [2930](https://github.com/grafana/loki/pull/2930) **cyriltovena**: Fixes all in one grpc registrations. 673* [2929](https://github.com/grafana/loki/pull/2929) **cyriltovena**: Cleanup labels parsing. 674* [2922](https://github.com/grafana/loki/pull/2922) **codewithcheese**: Distributor registers logproto.Pusher service to receive logs via GRPC 675* [2918](https://github.com/grafana/loki/pull/2918) **owen-d**: Includes delete routes for ruler namespaces 676* [2903](https://github.com/grafana/loki/pull/2903) **cyriltovena**: Limit series for metric queries. 677* [2892](https://github.com/grafana/loki/pull/2892) **cyriltovena**: Improve the chunksize test. 678* [2891](https://github.com/grafana/loki/pull/2891) **sandeepsukhani**: fix flaky load tables test for boltdb-shipper uploads table-manager 679* [2836](https://github.com/grafana/loki/pull/2836) **andir**: tests: fix quoting issues in test output when building with Go 1.15 680* [2831](https://github.com/grafana/loki/pull/2831) **sandeepsukhani**: fix flaky tests in boltdb-shipper 681* [2822](https://github.com/grafana/loki/pull/2822) **cyriltovena**: LogQL: Improve template format 682* [2794](https://github.com/grafana/loki/pull/2794) **sandeepsukhani**: Revendor cortex to latest master 683* [2764](https://github.com/grafana/loki/pull/2764) **owen-d**: WAL/marshalable chunks 684* [2751](https://github.com/grafana/loki/pull/2751) **jeschkies**: Logging: Log throughput and total bytes human readable. 685 686#### Helm 687* [2986](https://github.com/grafana/loki/pull/2986) **cyriltovena**: Move CI to helm3. 688* [2967](https://github.com/grafana/loki/pull/2967) **czunker**: Remove `helm init` 689* [2965](https://github.com/grafana/loki/pull/2965) **czunker**: [Helm Chart Loki] Add needed k8s objects for alerting config 690* [2940](https://github.com/grafana/loki/pull/2940) **slim-bean**: Helm: Update logstash to new chart and newer version 691* [2835](https://github.com/grafana/loki/pull/2835) **tracyde**: Iss2734 692* [2789](https://github.com/grafana/loki/pull/2789) **bewiwi**: Allows service targetPort modificaion 693* [2651](https://github.com/grafana/loki/pull/2651) **scottrigby**: helm chart: Fix broken logo 694 695#### Jsonnet 696* [2976](https://github.com/grafana/loki/pull/2976) **beorn7**: Improve promtail alerts to retain the namespace label 697* [2961](https://github.com/grafana/loki/pull/2961) **sandeepsukhani**: add missing ingester query routes in loki reads and operational dashboard 698* [2899](https://github.com/grafana/loki/pull/2899) **halcyondude**: gateway: fix regression in tanka jsonnet 699* [2873](https://github.com/grafana/loki/pull/2873) **Duologic**: fix(loki-mixin): refer to super.annotations 700* [2852](https://github.com/grafana/loki/pull/2852) **chancez**: production/ksonnet: Add config_hash annotation to gateway deployment based on gateway configmap 701* [2820](https://github.com/grafana/loki/pull/2820) **owen-d**: fixes promtail libsonnet tag. closes #2818 702* [2718](https://github.com/grafana/loki/pull/2718) **halcyondude**: parameterize PVC storage class (ingester, querier, compactor) 703 704 705#### Docs 706* [2969](https://github.com/grafana/loki/pull/2969) **simonswine**: Add community forum to README.md 707* [2968](https://github.com/grafana/loki/pull/2968) **yuichi10**: logcli: Fix logcli logql document URL 708* [2942](https://github.com/grafana/loki/pull/2942) **hedss**: Docs: Corrects Fluent Bit documentation link to build the plugin. 709* [2933](https://github.com/grafana/loki/pull/2933) **oddlittlebird**: Update CODEOWNERS 710* [2909](https://github.com/grafana/loki/pull/2909) **fredr**: Docs: Add max_cache_freshness_per_query to limit_config 711* [2890](https://github.com/grafana/loki/pull/2890) **dfang**: Fix typo 712* [2888](https://github.com/grafana/loki/pull/2888) **oddlittlebird**: Update CODEOWNERS 713* [2879](https://github.com/grafana/loki/pull/2879) **zhanghjster**: documentation: add tail_proxy_url option to query_frontend_config section 714* [2869](https://github.com/grafana/loki/pull/2869) **nehaev**: documentation: Add loki4j to the list of unofficial clients 715* [2853](https://github.com/grafana/loki/pull/2853) **RangerCD**: Fix typos in promtail 716* [2848](https://github.com/grafana/loki/pull/2848) **dminca**: documentation: fix broken link in Best Practices section 717* [2833](https://github.com/grafana/loki/pull/2833) **siavashs**: Docs: -querier.split-queries-by-day deprecation 718* [2819](https://github.com/grafana/loki/pull/2819) **owen-d**: updates docs with delete permissions notice 719* [2817](https://github.com/grafana/loki/pull/2817) **scoof**: Documentation: Add S3 IAM policy to be able to run Compactor 720* [2811](https://github.com/grafana/loki/pull/2811) **slim-bean**: Docs: improve the helm upgrade section 721* [2810](https://github.com/grafana/loki/pull/2810) **hedss**: CHANGELOG: Update update document links to point to the right place. 722* [2704](https://github.com/grafana/loki/pull/2704) **owen-d**: WAL design doc 723* [2636](https://github.com/grafana/loki/pull/2636) **LTek-online**: promtail documentation: changing the headers of the configuration docu to reflect configuration code 724 725#### Promtail 726* [2957](https://github.com/grafana/loki/pull/2957) **slim-bean**: Promtail: Update debian image and use a newer libsystemd 727* [2928](https://github.com/grafana/loki/pull/2928) **cyriltovena**: Skip journald bad message. 728* [2914](https://github.com/grafana/loki/pull/2914) **chancez**: promtail: Add support for using syslog message timestamp 729* [2910](https://github.com/grafana/loki/pull/2910) **rfratto**: Expose underlying promtail client 730 731 732#### Logcli 733* [2948](https://github.com/grafana/loki/pull/2948) **tomwilkie**: Add a few more instructions to logcli --help. 734 735#### Build 736* [2877](https://github.com/grafana/loki/pull/2877) **cyriltovena**: Update to go 1.15 737* [2814](https://github.com/grafana/loki/pull/2814) **torkelo**: Stats: Adding metrics collector GitHub action 738 739#### Fluentd 740* [2825](https://github.com/grafana/loki/pull/2825) **cyriltovena**: Bump fluentd plugin 741* [2434](https://github.com/grafana/loki/pull/2434) **andsens**: fluent-plugin: Improve escaping in key_value format 742 743 744### Notes 745 746This release was created from revision ae9c4b82ec4a5d21267da50d6a1a8170e0ef82ff (Which was PR 2960) and the following PR's were cherry-picked 747* [2984](https://github.com/grafana/loki/pull/2984) **owen-d**: adds the ability to read chunkFormatV3 while writing v2 748* [2974](https://github.com/grafana/loki/pull/2974) **hedss**: fluent-bit: Rename Fluent Bit plugin output name. 749 750### Dependencies 751 752* Go Version: 1.15.3 753* Cortex Version: 85942c5703cf22b64cecfd291e7e7c42d1b8c30c 754 755## 2.0.1 (2020/12/10) 756 7572.0.1 is a special release, it only exists to add the v3 support to Loki's chunk format. 758 759**There is no reason to upgrade from 2.0.0 to 2.0.1** 760 761This chunk version is internal to Loki and not configurable, and in a future version v3 will become the default (Likely 2.2.0). 762 763We are creating this to enable users to roll back from a future release which was writing v3 chunks, back as far as 2.0.0 and still be able to read chunks. 764 765This is mostly a safety measure to help if someone upgrades from 2.0.0 and skips versions to a future version which is writing v3 chunks and they encounter an issue which they would like to roll back. They would be able to then roll back to 2.0.1 and still read v3 chunks. 766 767It should be noted this does not help anyone upgrading from a version older than 2.0.0, that is you should at least upgrade to 2.0.0 before going to a newer version if you are on a version older than 2.0.0. 768 769## 2.0.0 (2020/10/26) 770 7712.0.0 is here!! 772 773We are extremely excited about the new features in 2.0.0, unlocking a whole new world of observability of our logs. 774 775Thanks again for the many incredible contributions and improvements from the wonderful Loki community, we are very excited for the future! 776 777### Important Notes 778 779**Please Note** There are several changes in this release which require your attention! 780 781* Anyone using a docker image please go read the [upgrade guide](https://github.com/grafana/loki/blob/master/docs/sources/upgrading/_index.md#200)!! There is one important consideration around a potentially breaking schema change depending on your configuration. 782* MAJOR changes have been made to the boltdb-shipper index, breaking changes are not expected but extra precautions are highly recommended, more details in the [upgrade guide](https://github.com/grafana/loki/blob/master/docs/sources/upgrading/_index.md#200). 783* The long deprecated `entry_parser` config in Promtail has been removed, use [pipeline_stages](https://grafana.com/docs/loki/latest/clients/promtail/configuration/#pipeline_stages) instead. 784 785Check the [upgrade guide](https://github.com/grafana/loki/blob/master/docs/sources/upgrading/_index.md#200) for detailed information on all these changes. 786 787### 2.0!!!! 788 789There are too many PR's to list individually for the major improvements which we thought justified a 2.0 but here is the high level: 790 791* Significant enhancements to the [LogQL query language](https://grafana.com/docs/loki/latest/logql/)! 792** [Parse](https://grafana.com/docs/loki/latest/logql/#parser-expression) your logs to extract labels at query time. 793** [Filter](https://grafana.com/docs/loki/latest/logql/#label-filter-expression) on query time extracted labels. 794** [Format](https://grafana.com/docs/loki/latest/logql/#line-format-expression) your log lines any way you please! 795** [Graph](https://grafana.com/docs/loki/latest/logql/#unwrapped-range-aggregations) the contents of your log lines as metrics, including support for many more of your favorite PromQL functions. 796* Generate prometheus [alerts directly from your logs](https://grafana.com/docs/loki/latest/alerting/)! 797** Create alerts using the same prometheus alert rule syntax and let Loki send alerts directly to your Prometheus Alertmanager! 798* [boltdb-shipper](https://grafana.com/docs/loki/latest/operations/storage/boltdb-shipper/) is now production ready! 799** This is it! Now Loki only needs a single object store (S3,GCS,Filesystem...) to store all the data, no more Cassandra, DynamoDB or Bigtable! 800 801We are extremely excited about these new features, expect some talks, webinars, and blogs where we explain all this new functionality in detail. 802 803### Notable mention 804 805This is a small change but very helpful! 806 807* [2737](https://github.com/grafana/loki/pull/2737) **dlemel8**: cmd/loki: add "verify-config" flag 808 809Thank you @dlemel8 for this PR! Now you can start Loki with `-verify-config` to make sure your config is valid and Loki will exit with a status code 0 if it is! 810 811### All Changes 812 813#### Loki 814* [2804](https://github.com/grafana/loki/pull/2804) **slim-bean**: Loki: log any chunk fetch failure 815* [2803](https://github.com/grafana/loki/pull/2803) **slim-bean**: Update local and docker default config files to use boltdb-shipper with a few other config changes 816* [2796](https://github.com/grafana/loki/pull/2796) **cyriltovena**: Fixes a bug that would add __error__ label incorrectly. 817* [2793](https://github.com/grafana/loki/pull/2793) **cyriltovena**: Improve the way we reverse iterator for backward queries. 818* [2790](https://github.com/grafana/loki/pull/2790) **sandeepsukhani**: Boltdb shipper metrics changes 819* [2788](https://github.com/grafana/loki/pull/2788) **sandeepsukhani**: add a metric in compactor to record timestamp of last successful run 820* [2786](https://github.com/grafana/loki/pull/2786) **cyriltovena**: Logqlv2 pushes groups down to edge 821* [2778](https://github.com/grafana/loki/pull/2778) **cyriltovena**: Logqv2 optimization 822* [2774](https://github.com/grafana/loki/pull/2774) **cyriltovena**: Handle panic in the store goroutine. 823* [2773](https://github.com/grafana/loki/pull/2773) **cyriltovena**: Fixes race conditions in the batch iterator. 824* [2770](https://github.com/grafana/loki/pull/2770) **sandeepsukhani**: Boltdb shipper query performance improvements 825* [2769](https://github.com/grafana/loki/pull/2769) **cyriltovena**: LogQL: Labels and Metrics Extraction 826* [2768](https://github.com/grafana/loki/pull/2768) **cyriltovena**: Fixes all lint errors. 827* [2761](https://github.com/grafana/loki/pull/2761) **owen-d**: Service discovery refactor 828* [2755](https://github.com/grafana/loki/pull/2755) **owen-d**: Revendor Cortex 829* [2752](https://github.com/grafana/loki/pull/2752) **kavirajk**: fix: Remove depricated `entry_parser` from scrapeconfig 830* [2741](https://github.com/grafana/loki/pull/2741) **owen-d**: better tenant logging in ruler memstore 831* [2737](https://github.com/grafana/loki/pull/2737) **dlemel8**: cmd/loki: add "verify-config" flag 832* [2735](https://github.com/grafana/loki/pull/2735) **cyriltovena**: Fixes the frontend logs to include org_id. 833* [2732](https://github.com/grafana/loki/pull/2732) **sandeepsukhani**: set timestamp in instant query done by canaries 834* [2726](https://github.com/grafana/loki/pull/2726) **dvrkps**: hack: clean getStore 835* [2711](https://github.com/grafana/loki/pull/2711) **owen-d**: removes r/w pools from block/chunk types 836* [2709](https://github.com/grafana/loki/pull/2709) **cyriltovena**: Bypass sharding middleware when a query can't be sharded. 837* [2671](https://github.com/grafana/loki/pull/2671) **alrs**: pkg/querier: fix dropped error 838* [2665](https://github.com/grafana/loki/pull/2665) **cnbailian**: Loki: Querier APIs respond JSON Content-Type 839* [2663](https://github.com/grafana/loki/pull/2663) **owen-d**: improves numeric literal stringer impl 840* [2662](https://github.com/grafana/loki/pull/2662) **owen-d**: exposes rule group validation fn 841* [2661](https://github.com/grafana/loki/pull/2661) **owen-d**: Enable local rules backend & disallow configdb. 842* [2656](https://github.com/grafana/loki/pull/2656) **sandeepsukhani**: run multiple queries per table at once with boltdb-shipper 843* [2655](https://github.com/grafana/loki/pull/2655) **sandeepsukhani**: fix store query bug when running loki in single binary mode with boltdb-shipper 844* [2650](https://github.com/grafana/loki/pull/2650) **owen-d**: Adds prometheus ruler routes 845* [2647](https://github.com/grafana/loki/pull/2647) **arl**: pkg/chunkenc: fix test using string(int) conversion 846* [2645](https://github.com/grafana/loki/pull/2645) **arl**: Tests: fix issue 2356: distributor_test.go fails when the system has no interface name in [eth0, en0, lo0] 847* [2642](https://github.com/grafana/loki/pull/2642) **sandeepsukhani**: fix an issue with building loki 848* [2640](https://github.com/grafana/loki/pull/2640) **sandeepsukhani**: improvements for boltdb-shipper compactor 849* [2637](https://github.com/grafana/loki/pull/2637) **owen-d**: Ruler docs + single binary inclusion 850* [2627](https://github.com/grafana/loki/pull/2627) **sandeepsukhani**: revendor cortex to latest master 851* [2620](https://github.com/grafana/loki/pull/2620) **alrs**: pkg/storage/stores/shipper/uploads: fix test error 852* [2614](https://github.com/grafana/loki/pull/2614) **cyriltovena**: Improve lz4 compression 853* [2613](https://github.com/grafana/loki/pull/2613) **sandeepsukhani**: fix a panic when trying to stop boltdb-shipper multiple times using sync.once 854* [2610](https://github.com/grafana/loki/pull/2610) **slim-bean**: Loki: Fix query-frontend ready handler 855* [2601](https://github.com/grafana/loki/pull/2601) **sandeepsukhani**: rpc for querying ingesters to get chunk ids from its store 856* [2589](https://github.com/grafana/loki/pull/2589) **owen-d**: Ruler/loki rule validator 857* [2582](https://github.com/grafana/loki/pull/2582) **yeya24**: Add _total suffix to ruler counter metrics 858* [2580](https://github.com/grafana/loki/pull/2580) **owen-d**: strict rule unmarshaling 859* [2578](https://github.com/grafana/loki/pull/2578) **owen-d**: exports grouploader 860* [2576](https://github.com/grafana/loki/pull/2576) **owen-d**: Better rule loading 861* [2574](https://github.com/grafana/loki/pull/2574) **sandeepsukhani**: fix closing of compressed file from boltdb-shipper compactor 862* [2572](https://github.com/grafana/loki/pull/2572) **adityacs**: Validate max_query_length in Labels API 863* [2564](https://github.com/grafana/loki/pull/2564) **owen-d**: Error on no schema configs 864* [2559](https://github.com/grafana/loki/pull/2559) **sandeepsukhani**: fix dir setup based on which mode it is running 865* [2558](https://github.com/grafana/loki/pull/2558) **sandeepsukhani**: cleanup boltdb files in queriers during startup/shutdown 866* [2552](https://github.com/grafana/loki/pull/2552) **owen-d**: fixes batch metrics help text & corrects bucketing 867* [2550](https://github.com/grafana/loki/pull/2550) **sandeepsukhani**: fix a flaky test in boltdb shipper 868* [2548](https://github.com/grafana/loki/pull/2548) **sandeepsukhani**: add some metrics for monitoring compactor 869* [2546](https://github.com/grafana/loki/pull/2546) **sandeepsukhani**: register boltdb shipper compactor cli flags 870* [2543](https://github.com/grafana/loki/pull/2543) **sandeepsukhani**: revendor cortex to latest master 871* [2534](https://github.com/grafana/loki/pull/2534) **owen-d**: Consistent chunk metrics 872* [2530](https://github.com/grafana/loki/pull/2530) **sandeepsukhani**: minor fixes and improvements for boltdb shipper 873* [2526](https://github.com/grafana/loki/pull/2526) **sandeepsukhani**: compactor for compacting boltdb files uploaded by shipper 874* [2510](https://github.com/grafana/loki/pull/2510) **owen-d**: adds batch based metrics 875* [2507](https://github.com/grafana/loki/pull/2507) **sandeepsukhani**: compress boltdb files to gzip while uploading from shipper 876* [2458](https://github.com/grafana/loki/pull/2458) **owen-d**: Feature/ruler (take 2) 877* [2487](https://github.com/grafana/loki/pull/2487) **sandeepsukhani**: upload boltdb files from shipper only when they are not expected to be modified or during shutdown 878 879#### Docs 880* [2797](https://github.com/grafana/loki/pull/2797) **cyriltovena**: Logqlv2 docs 881* [2772](https://github.com/grafana/loki/pull/2772) **DesistDaydream**: reapir Retention Example Configuration 882* [2762](https://github.com/grafana/loki/pull/2762) **PabloCastellano**: fix: typo in upgrade.md 883* [2750](https://github.com/grafana/loki/pull/2750) **owen-d**: fixes path in prom rules api docs 884* [2733](https://github.com/grafana/loki/pull/2733) **owen-d**: Removes wrong capitalizations 885* [2728](https://github.com/grafana/loki/pull/2728) **vishesh92**: Docs: Update docs for redis 886* [2725](https://github.com/grafana/loki/pull/2725) **dvrkps**: fix some misspells 887* [2724](https://github.com/grafana/loki/pull/2724) **MadhavJivrajani**: DOCS: change format of unordered lists in technical docs 888* [2716](https://github.com/grafana/loki/pull/2716) **huikang**: Doc: fixing parameter name in configuration 889* [2705](https://github.com/grafana/loki/pull/2705) **owen-d**: shows cortextool lint command for loki in alerting docs 890* [2702](https://github.com/grafana/loki/pull/2702) **huikang**: Doc: fix broken links in production/README.md 891* [2699](https://github.com/grafana/loki/pull/2699) **sandangel**: docs: use repetitive numbering 892* [2698](https://github.com/grafana/loki/pull/2698) **bemasher**: Doc: Vague link text. 893* [2697](https://github.com/grafana/loki/pull/2697) **owen-d**: updates alerting docs with new cortex tool loki linting support 894* [2692](https://github.com/grafana/loki/pull/2692) **philnichol**: Docs: Corrected incorrect instances of (setup|set up) 895* [2691](https://github.com/grafana/loki/pull/2691) **UniqueTokens**: Update metrics.md 896* [2689](https://github.com/grafana/loki/pull/2689) **pgassmann**: docker plugin documentation update 897* [2686](https://github.com/grafana/loki/pull/2686) **demon**: docs: Fix link to code of conduct 898* [2657](https://github.com/grafana/loki/pull/2657) **owen-d**: fixes ruler docs & includes ruler configs in cmd/configs + docker img 899* [2622](https://github.com/grafana/loki/pull/2622) **sandeepsukhani**: add compactor details and other boltdb-shipper doc improvments 900* [2621](https://github.com/grafana/loki/pull/2621) **cyriltovena**: Fixes links in aws tutorials. 901* [2606](https://github.com/grafana/loki/pull/2606) **cyriltovena**: More template stage examples. 902* [2605](https://github.com/grafana/loki/pull/2605) **Decad**: Update docs to use raw link 903* [2600](https://github.com/grafana/loki/pull/2600) **slim-bean**: Docs: Fix broken links on generated site 904* [2597](https://github.com/grafana/loki/pull/2597) **nek-00-ken**: Fixup: url to access promtail config sample 905* [2595](https://github.com/grafana/loki/pull/2595) **sh0rez**: docs: fix broken links 906* [2594](https://github.com/grafana/loki/pull/2594) **wardbekker**: Update README.md 907* [2592](https://github.com/grafana/loki/pull/2592) **owen-d**: fixes some doc links 908* [2591](https://github.com/grafana/loki/pull/2591) **woodsaj**: Docs: fix links in installation docs 909* [2586](https://github.com/grafana/loki/pull/2586) **ms42Q**: Doc fixes: remove typos and long sentence 910* [2579](https://github.com/grafana/loki/pull/2579) **oddlittlebird**: Update CODEOWNERS 911* [2566](https://github.com/grafana/loki/pull/2566) **owen-d**: Website doc link fixes 912* [2528](https://github.com/grafana/loki/pull/2528) **owen-d**: Update tanka.md with steps for using k8s-alpha lib 913* [2512](https://github.com/grafana/loki/pull/2512) **palemtnrider**: Documentation: Fixes install and getting-started links in the readme 914* [2508](https://github.com/grafana/loki/pull/2508) **owen-d**: memberlist correct yaml path. closes #2499 915* [2506](https://github.com/grafana/loki/pull/2506) **ferdikurniawan**: Docs: fix dead link 916* [2505](https://github.com/grafana/loki/pull/2505) **sh0rez**: doc: close code block 917* [2501](https://github.com/grafana/loki/pull/2501) **tivvit**: fix incorrect upgrade link 918* [2500](https://github.com/grafana/loki/pull/2500) **oddlittlebird**: Docs: Update README.md 919 920#### Helm 921* [2746](https://github.com/grafana/loki/pull/2746) **marcosartori**: helm/fluentbit K8S-Logging.Exclude & and Mem_Buf_Limit toggle 922* [2742](https://github.com/grafana/loki/pull/2742) **steven-sheehy**: Fix linting errors and use of deprecated repositories 923* [2659](https://github.com/grafana/loki/pull/2659) **rskrishnar**: [Promtail] enables configuring psp in helm chart 924* [2554](https://github.com/grafana/loki/pull/2554) **alexandre-allard-scality**: production/helm: add support for PV selector in Loki statefulset 925 926#### FluentD 927* [2739](https://github.com/grafana/loki/pull/2739) **jgehrcke**: FluentD loki plugin: add support for bearer_token_file parameter 928 929#### Fluent Bit 930* [2568](https://github.com/grafana/loki/pull/2568) **zjj2wry**: fluent-bit plugin support TLS 931 932#### Promtail 933* [2723](https://github.com/grafana/loki/pull/2723) **carlpett**: Promtail: Add counter promtail_batch_retries_total 934* [2717](https://github.com/grafana/loki/pull/2717) **slim-bean**: Promtail: Fix deadlock on tailer shutdown. 935* [2710](https://github.com/grafana/loki/pull/2710) **slim-bean**: Promtail: (and also fluent-bit) change the max batch size to 1MB 936* [2708](https://github.com/grafana/loki/pull/2708) **Falco20019**: Promtail: Fix timestamp parser for short year format 937* [2658](https://github.com/grafana/loki/pull/2658) **slim-bean**: Promtail: do not mark the position if the file is removed 938* [2618](https://github.com/grafana/loki/pull/2618) **slim-bean**: Promtail: Add a stream lagging metric 939* [2615](https://github.com/grafana/loki/pull/2615) **aminjam**: Add fallback_formats for timestamp stage 940* [2603](https://github.com/grafana/loki/pull/2603) **rfratto**: Expose UserAgent and fix User-Agent version source 941* [2575](https://github.com/grafana/loki/pull/2575) **unguiculus**: Promtail: Fix docker-compose.yaml 942* [2571](https://github.com/grafana/loki/pull/2571) **rsteneteg**: Promtail: adding pipeline stage for dropping labels 943* [2570](https://github.com/grafana/loki/pull/2570) **slim-bean**: Promtail: Fix concurrent map iteration when using stdin 944* [2565](https://github.com/grafana/loki/pull/2565) **carlpett**: Add a counter for empty syslog messages 945* [2542](https://github.com/grafana/loki/pull/2542) **slim-bean**: Promtail: implement shutdown for the no-op server 946* [2532](https://github.com/grafana/loki/pull/2532) **slim-bean**: Promtail: Restart the tailer if we fail to read and upate current position 947 948#### Ksonnet 949* [2719](https://github.com/grafana/loki/pull/2719) **halcyondude**: nit: fix formatting for ksonnet/loki 950* [2677](https://github.com/grafana/loki/pull/2677) **sandeepsukhani**: fix jsonnet for memcached-writes when using boltdb-shipper 951* [2617](https://github.com/grafana/loki/pull/2617) **periklis**: Add config options for loki dashboards 952* [2612](https://github.com/grafana/loki/pull/2612) **fredr**: Dashboard: typo in Loki Operational dashboard 953* [2599](https://github.com/grafana/loki/pull/2599) **sandeepsukhani**: fix closing bracket in dashboards from loki-mixin 954* [2584](https://github.com/grafana/loki/pull/2584) **sandeepsukhani**: Read, Write and operational dashboard improvements 955* [2560](https://github.com/grafana/loki/pull/2560) **owen-d**: Jsonnet/ruler 956* [2547](https://github.com/grafana/loki/pull/2547) **sandeepsukhani**: jsonnet for running loki using boltdb-shipper 957* [2525](https://github.com/grafana/loki/pull/2525) **Duologic**: fix(ksonnet): don't depend on specific k8s version 958* [2521](https://github.com/grafana/loki/pull/2521) **charandas**: fix: broken links in Tanka documentation 959* [2503](https://github.com/grafana/loki/pull/2503) **owen-d**: Ksonnet docs 960* [2494](https://github.com/grafana/loki/pull/2494) **primeroz**: Jsonnet Promtail: Change function for mounting configmap in promtail daemonset 961 962#### Logstash 963* [2607](https://github.com/grafana/loki/pull/2607) **adityacs**: Logstash cpu usage fix 964 965#### Build 966* [2602](https://github.com/grafana/loki/pull/2602) **sandeepsukhani**: add support for building querytee 967* [2561](https://github.com/grafana/loki/pull/2561) **tharun208**: Added logcli docker image 968* [2549](https://github.com/grafana/loki/pull/2549) **simnv**: Ignore .exe files build for Windows 969* [2527](https://github.com/grafana/loki/pull/2527) **owen-d**: Update docker-compose.yaml to use 1.6.0 970 971#### Docker Logging Driver 972* [2459](https://github.com/grafana/loki/pull/2459) **RaitoBezarius**: Docker logging driver: Add a keymod for the extra attributes from the Docker logging driver 973 974### Dependencies 975 976* Go Version: 1.14.2 977* Cortex Version: 85942c5703cf22b64cecfd291e7e7c42d1b8c30c 978 979## 1.6.1 (2020-08-24) 980 981This is a small release and only contains two fixes for Promtail: 982 983* [2542](https://github.com/grafana/loki/pull/2542) **slim-bean**: Promtail: implement shutdown for the no-op server 984* [2532](https://github.com/grafana/loki/pull/2532) **slim-bean**: Promtail: Restart the tailer if we fail to read and upate current position 985 986The first only applies if you are running Promtail with both `--stdin` and `--server.disabled=true` flags. 987 988The second is a minor rework to how Promtail handles a very specific error when attempting to read the size of a file and failing to do so. 989 990Upgrading Promtail from 1.6.0 to 1.6.1 is only necessary if you have logs full of `msg="error getting tail position and/or size"`, 991the code changed in this release has been unchanged for a long time and we suspect very few people are seeing this issue. 992 993No changes to any other components (Loki, Logcli, etc) are included in this release. 994 995## 1.6.0 (2020-08-13) 996 997It's the second thursday of the eighth month of the year which means it's time for another Loki Release!! 998 999Before we highlight important features and changes, congratulations to [@adityacs](https://github.com/adityacs), who is the newest member of the Loki team! 1000Aditya has been regularly contributing to the Loki project for the past year, with each contribution better than the last. 1001Many of the items on the following list were thanks to his hard work. Thank you, Aditya, and welcome to the team! 1002 1003I think we might have set a new record with 189 PR's in this release! 1004 1005### Important Notes 1006 1007**Please Note** There are several changes in this release which might require your attention! 1008 1009* The NET_BIND_SERVICE capability was removed from the Loki process in the docker image, it's no longer possible to run Loki with the supplied image on a port less than 1024 1010* If you run microservices, there is an important rollout sequence to prevent query errors. 1011* Scrape configs have changed for Promtail in both Helm and Ksonnet affecting two labels: `instance` -> `pod` and `container_name` -> `container`. 1012* Almost all of the Loki Canary metrics were renamed. 1013* A few command line flags where changed (although they are likely not commonly used) 1014* If you use ksonnet and run on GCS and Bigtable you may see an error in your config as a default value was removed. 1015* If you are using boltdb-shipper, you will likekly need to add a new schema_config entry. 1016 1017Check the [upgrade guide](https://github.com/grafana/loki/blob/master/docs/sources/operations/upgrade.md#160) for detailed information on all these changes. 1018 1019### Notable Features and Fixes 1020 1021#### Query language enhancements 1022 1023* [2150](https://github.com/grafana/loki/pull/2150) introduces `bytes_rate`, which calculates the per second byte rate of a log stream, and `bytes_over_time`, which returns the byte size of a log stream. 1024* [2182](https://github.com/grafana/loki/pull/2182) introduces a long list of comparison operators, which will let you write queries like `count_over_time({foo="bar"}[1m]) > 10`. Check out the PR for a more detailed description. 1025 1026#### Loki performance improvements 1027 1028* [2216](https://github.com/grafana/loki/pull/2216), [2218](https://github.com/grafana/loki/pull/2218), and [2219](https://github.com/grafana/loki/pull/2219) all improve how memory is allocated and reused for queries. 1029* [2239](https://github.com/grafana/loki/pull/2239) is a huge improvement for certain cases in which a query covers a large number of streams that all overlap in time. Overlapping data is now internally cached while Loki works to sort all the streams into the proper time order. 1030* [2293](https://github.com/grafana/loki/pull/2293) was a big refactor to how Loki internally processes log queries vs. metric queries, creating separate code paths to further optimize metric queries. Metric query performance is now 2 to 10 times faster. 1031 1032If you are using the query-frontend: 1033 1034* [2441](https://github.com/grafana/loki/pull/2441) improves how label queries can be split and queried in parallel 1035* [2123](https://github.com/grafana/loki/pull/2123) allows queries to the `series` API to be split by time and parallelized; and last but most significant 1036* [1927](https://github.com/grafana/loki/pull/1927) allows for a much larger range of queries to be sharded and performed in parallel. Query sharding is a topic in itself, but as a rough summary, this type of sharding is not time dependent and leverages how data is already stored by Loki to be able to split queries up into 16 separate pieces to be queried at the same time. 1037 1038#### Promtail 1039 1040* [2296](https://github.com/grafana/loki/pull/2296) allows Promtail to expose the Loki Push API. With this, you can push from any client to Promtail as if it were Loki, and Promtail can then forward those logs to another Promtail or to Loki. There are some good use cases for this with the Loki Docker Logging Driver; if you want an easier way to configure pipelines or expose metrics collection, point your Docker drivers at a Promtail instance. 1041* [2282](https://github.com/grafana/loki/pull/2282) contains an example Amazon Lambda where you can use a fan-in approach and ingestion timestamping in Promtail to work around `out of order` issues with multiple Lambdas processing the same log stream. This is one way to get logs from a high-cardinality source without adding a high-cardinality label. 1042* [2060](https://github.com/grafana/loki/pull/2060) introduces the `Replace` stage, which lets you find and replace or remove text inside a log line. Combined with [2422](https://github.com/grafana/loki/pull/2422) and [2480](https://github.com/grafana/loki/pull/2480), you can now find and replace sensitive data in a log line like a password or email address and replace it with ****, or hash the value to prevent readability, while still being able to trace the value through your logs. Last on the list of pipeline additions, 1043* [2496](https://github.com/grafana/loki/pull/2496) adds a `Drop` pipeline stage, which lets you drop log lines based on several criteria options including regex matching content, line length, or the age of the log line. The last two are useful to prevent sending to Loki logs that you know would be rejected based on configured limits in the Loki server. 1044 1045#### Logstash output plugin 1046 1047* [1822](https://github.com/grafana/loki/pull/1822) added a Logstash output plugin for Loki. If you have an existing Logstash install, you can now use this plugin to send your logs to Loki to make it easier to try out, or use Loki alongside an existing logging installation. 1048 1049#### Loki Canary 1050 1051* [2344](https://github.com/grafana/loki/pull/2344) improved the canaries capabilities for checking for data integrity, including spot checking for logs over a longer time window and running metric queries to verify count_over_time accuracy. 1052 1053#### Logcli 1054 1055* [2470](https://github.com/grafana/loki/pull/2470) allows you to color code your log lines based on their stream labels for a nice visual indicator of streams. 1056* [2497](https://github.com/grafana/loki/pull/2497) expands on the series API query to Loki with the`--analyze-labels` flag, which can show you a detailed breakdown of your label key and value combinations. This is very useful for finding improper label usage in Loki or labels with high cardinality. 1057* [2482](https://github.com/grafana/loki/pull/2482), in which LogCLI will automatically batch requests to Loki to allow making queries with a `--limit=` far larger than the server side limit defined in Loki. LogCLI will dispatch the request in a series of queries configured by the `--batch=` parameter (which defaults to 1000) until the requested limit is reached! 1058 1059#### Misc 1060 1061* [2453](https://github.com/grafana/loki/pull/2453) improves the error messages when a query times out, as `Context Deadline Exceeded` wasn’t the most intuitive. 1062* [2336](https://github.com/grafana/loki/pull/2336) provides two new flags that will print the entire Loki config object at startup. Be warned there are a lot of config options, and many won’t apply to your setup (such as storage configs you aren’t using), but this can be a really useful tool when troubleshooting. Sticking with the theme of best for last, 1063* [2224](https://github.com/grafana/loki/pull/2224) and [2288](https://github.com/grafana/loki/pull/2288) improve support for running Loki with a shared Ring using memberlist while not requiring Consul or Etcd. We need to follow up soon with some better documentation or a blog post on this! 1064 1065 1066### Dependencies 1067 1068* Go Version: 1.14.2 1069* Cortex Version: 7014ff11ed70d9d59ad29d0a95e73999c436c47c 1070 1071### All Changes 1072 1073#### Loki 1074* [2484](https://github.com/grafana/loki/pull/2484) **slim-bean**: Loki: fix batch iterator error when all chunks overlap and chunk time ranges are greater than query time range 1075* [2483](https://github.com/grafana/loki/pull/2483) **sandeepsukhani**: download boltdb files parallelly during reads 1076* [2472](https://github.com/grafana/loki/pull/2472) **owen-d**: series endpoint uses normal splits 1077* [2466](https://github.com/grafana/loki/pull/2466) **owen-d**: BatchIter edge cases 1078* [2463](https://github.com/grafana/loki/pull/2463) **sandeepsukhani**: revendor cortex to latest master 1079* [2457](https://github.com/grafana/loki/pull/2457) **adityacs**: Fix panic in cassandra storage while registering metrics 1080* [2453](https://github.com/grafana/loki/pull/2453) **slim-bean**: Loki: Improve error messages on query timeout or cancel 1081* [2450](https://github.com/grafana/loki/pull/2450) **adityacs**: Fixes panic in runtime_config 1082* [2449](https://github.com/grafana/loki/pull/2449) **jvrplmlmn**: Replace usage of sync/atomic with uber-go/atomic 1083* [2441](https://github.com/grafana/loki/pull/2441) **cyriltovena**: Split label names queries in the frontend. 1084* [2427](https://github.com/grafana/loki/pull/2427) **owen-d**: Revendor cortex 1085* [2392](https://github.com/grafana/loki/pull/2392) **owen-d**: avoid mutating config while parsing -config.file 1086* [2346](https://github.com/grafana/loki/pull/2346) **cyriltovena**: Fixes LogQL grouping 1087* [2336](https://github.com/grafana/loki/pull/2336) **slim-bean**: Loki: add -print-config-stderr flag to dump loki's runtime config to stderr 1088* [2330](https://github.com/grafana/loki/pull/2330) **slim-bean**: Loki: Use a new context to update the ring state after a failed chunk transfer 1089* [2328](https://github.com/grafana/loki/pull/2328) **slim-bean**: Loki: Transfer one chunk at a time per series during chunk transfers 1090* [2327](https://github.com/grafana/loki/pull/2327) **adityacs**: Fix data race in ingester 1091* [2323](https://github.com/grafana/loki/pull/2323) **cyriltovena**: Improve object key parsing for boltdb shipper. 1092* [2306](https://github.com/grafana/loki/pull/2306) **cyriltovena**: Fixes buffered iterator skipping very long lines. 1093* [2302](https://github.com/grafana/loki/pull/2302) **cyriltovena**: Improve entry deduplication. 1094* [2294](https://github.com/grafana/loki/pull/2294) **cyriltovena**: Remove NET_BIND_SERVICE capability requirement. 1095* [2293](https://github.com/grafana/loki/pull/2293) **cyriltovena**: Improve metric queries by computing samples at the edges. 1096* [2288](https://github.com/grafana/loki/pull/2288) **periklis**: Add support for memberlist dns-based discovery 1097* [2268](https://github.com/grafana/loki/pull/2268) **owen-d**: lock fix for flaky test 1098* [2266](https://github.com/grafana/loki/pull/2266) **cyriltovena**: Update to latest cortex. 1099* [2264](https://github.com/grafana/loki/pull/2264) **adityacs**: Fix ingester results for series query 1100* [2261](https://github.com/grafana/loki/pull/2261) **sandeepsukhani**: create smaller unique files from boltdb shipper and other code refactorings 1101* [2254](https://github.com/grafana/loki/pull/2254) **slim-bean**: Loki: Series API will return all series with no match or empty matcher 1102* [2252](https://github.com/grafana/loki/pull/2252) **owen-d**: avoids further time splitting in querysharding mware 1103* [2250](https://github.com/grafana/loki/pull/2250) **slim-bean**: Loki: Remove redundant log warning 1104* [2249](https://github.com/grafana/loki/pull/2249) **owen-d**: avoids recording stats in the sharded engine 1105* [2248](https://github.com/grafana/loki/pull/2248) **cyriltovena**: Add performance profile flags for logcli. 1106* [2239](https://github.com/grafana/loki/pull/2239) **cyriltovena**: Cache overlapping blocks 1107* [2224](https://github.com/grafana/loki/pull/2224) **periklis**: Replace memberlist service in favor of cortex provided service 1108* [2223](https://github.com/grafana/loki/pull/2223) **adityacs**: Add Error method for step evaluators 1109* [2219](https://github.com/grafana/loki/pull/2219) **cyriltovena**: Reuse slice for the range vector allocations. 1110* [2218](https://github.com/grafana/loki/pull/2218) **cyriltovena**: Reuse buffer for hash computation in the engine. 1111* [2216](https://github.com/grafana/loki/pull/2216) **cyriltovena**: Improve point allocations for each steps in the logql engine. 1112* [2211](https://github.com/grafana/loki/pull/2211) **sandeepsukhani**: query tee proxy with support for comparison of responses 1113* [2206](https://github.com/grafana/loki/pull/2206) **sandeepsukhani**: disable index dedupe when rf > 1 and current or upcoming index type is boltdb-shipper 1114* [2204](https://github.com/grafana/loki/pull/2204) **owen-d**: bumps cortex & fixes conflicts 1115* [2191](https://github.com/grafana/loki/pull/2191) **periklis**: Add flag to disable tracing activation 1116* [2189](https://github.com/grafana/loki/pull/2189) **owen-d**: Fix vector-scalar comparisons 1117* [2182](https://github.com/grafana/loki/pull/2182) **owen-d**: Logql comparison ops 1118* [2178](https://github.com/grafana/loki/pull/2178) **cyriltovena**: Fixes path prefix in the querier. 1119* [2166](https://github.com/grafana/loki/pull/2166) **sandeepsukhani**: enforce requirment for periodic config for index tables to be 24h when using boltdb shipper 1120* [2161](https://github.com/grafana/loki/pull/2161) **cyriltovena**: Fix error message for max tail connections. 1121* [2156](https://github.com/grafana/loki/pull/2156) **sandeepsukhani**: boltdb shipper download failure handling and some refactorings 1122* [2150](https://github.com/grafana/loki/pull/2150) **cyriltovena**: Bytes aggregations 1123* [2136](https://github.com/grafana/loki/pull/2136) **cyriltovena**: Fixes Iterator boundaries 1124* [2123](https://github.com/grafana/loki/pull/2123) **adityacs**: Fix Series API slowness 1125* [1927](https://github.com/grafana/loki/pull/1927) **owen-d**: Feature/querysharding ii 1126* [2032](https://github.com/grafana/loki/pull/2032) **tivvit**: Added support for tail to query frontend 1127 1128#### Promtail 1129* [2496](https://github.com/grafana/loki/pull/2496) **slim-bean**: Promtail: Drop stage 1130* [2475](https://github.com/grafana/loki/pull/2475) **slim-bean**: Promtail: force the log level on any Loki Push API target servers to match Promtail's log level. 1131* [2474](https://github.com/grafana/loki/pull/2474) **slim-bean**: Promtail: use --client.external-labels for all clients 1132* [2471](https://github.com/grafana/loki/pull/2471) **owen-d**: Fix/promtail yaml config 1133* [2464](https://github.com/grafana/loki/pull/2464) **slim-bean**: Promtail: Bug: loki push api, clone labels before handling 1134* [2438](https://github.com/grafana/loki/pull/2438) **rfratto**: pkg/promtail: propagate a logger rather than using util.Logger globally 1135* [2432](https://github.com/grafana/loki/pull/2432) **pyr0hu**: Promtail: Allow empty replace values for replace stage 1136* [2422](https://github.com/grafana/loki/pull/2422) **wardbekker**: Template: Added a sha256 template function for obfuscating / anonymize PII data in e.g. the replace stage 1137* [2414](https://github.com/grafana/loki/pull/2414) **rfratto**: Add RegisterFlagsWithPrefix to config structs 1138* [2386](https://github.com/grafana/loki/pull/2386) **cyriltovena**: Add regex function to promtail template stage. 1139* [2345](https://github.com/grafana/loki/pull/2345) **adityacs**: Refactor Promtail target manager code 1140* [2301](https://github.com/grafana/loki/pull/2301) **flixr**: Promtail: support unix timestamps with fractional seconds 1141* [2296](https://github.com/grafana/loki/pull/2296) **slim-bean**: Promtail: Loki Push API 1142* [2282](https://github.com/grafana/loki/pull/2282) **owen-d**: Lambda-Promtail 1143* [2242](https://github.com/grafana/loki/pull/2242) **carlpett**: Set user agent on outgoing http requests 1144* [2196](https://github.com/grafana/loki/pull/2196) **cyriltovena**: Adds default -config.file for the promtail docker images. 1145* [2127](https://github.com/grafana/loki/pull/2127) **bastjan**: Update go-syslog to accept non-UTF8 encoding in syslog message 1146* [2111](https://github.com/grafana/loki/pull/2111) **adityacs**: Fix Promtail journal seeking known position 1147* [2105](https://github.com/grafana/loki/pull/2105) **fatpat**: promtail: Add Entry variable to template 1148* [1118](https://github.com/grafana/loki/pull/1118) **shuttie**: promtail: fix high CPU usage on large kubernetes clusters. 1149* [2060](https://github.com/grafana/loki/pull/2060) **adityacs**: Feature: Replace stage in pipeline 1150* [2087](https://github.com/grafana/loki/pull/2087) **adityacs**: Set JournalTarget Priority value to keyword 1151 1152#### Logcli 1153* [2497](https://github.com/grafana/loki/pull/2497) **slim-bean**: logcli: adds --analyize-labels to logcli series command and changes how labels are provided to the command 1154* [2482](https://github.com/grafana/loki/pull/2482) **slim-bean**: Logcli: automatically batch requests 1155* [2470](https://github.com/grafana/loki/pull/2470) **adityacs**: colored labels output for logcli 1156* [2235](https://github.com/grafana/loki/pull/2235) **pstibrany**: logcli: Remove single newline from the raw line before printing. 1157* [2126](https://github.com/grafana/loki/pull/2126) **cyriltovena**: Validate local storage config for the logcli 1158* [2083](https://github.com/grafana/loki/pull/2083) **adityacs**: Support querying labels on time range in logcli 1159 1160#### Docs 1161* [2473](https://github.com/grafana/loki/pull/2473) **owen-d**: fixes lambda-promtail relative doc link 1162* [2454](https://github.com/grafana/loki/pull/2454) **oddlittlebird**: Create CODEOWNERS 1163* [2439](https://github.com/grafana/loki/pull/2439) **till**: Docs: updated "Upgrading" for docker driver 1164* [2437](https://github.com/grafana/loki/pull/2437) **wardbekker**: DOCS: clarified globbing behaviour of __path__ of the doublestar library 1165* [2431](https://github.com/grafana/loki/pull/2431) **endu**: fix dead link 1166* [2425](https://github.com/grafana/loki/pull/2425) **RichiH**: Change conduct contact email address 1167* [2420](https://github.com/grafana/loki/pull/2420) **petuhovskiy**: Fix docker driver doc 1168* [2418](https://github.com/grafana/loki/pull/2418) **cyriltovena**: Add logstash to clients page with FrontMatter. 1169* [2402](https://github.com/grafana/loki/pull/2402) **cyriltovena**: More fixes for the website. 1170* [2400](https://github.com/grafana/loki/pull/2400) **tontongg**: Fix URL to LogQL documentation 1171* [2398](https://github.com/grafana/loki/pull/2398) **robbymilo**: Docs - update links, readme 1172* [2397](https://github.com/grafana/loki/pull/2397) **coderanger**: �� Note that entry_parser is deprecated. 1173* [2396](https://github.com/grafana/loki/pull/2396) **dnsmichi**: Docs: Fix Fluentd title (visible in menu) 1174* [2391](https://github.com/grafana/loki/pull/2391) **cyriltovena**: Update fluentd docs and fixes links for the website. 1175* [2390](https://github.com/grafana/loki/pull/2390) **cyriltovena**: Fluent bit docs 1176* [2389](https://github.com/grafana/loki/pull/2389) **cyriltovena**: Docker driver doc 1177* [2385](https://github.com/grafana/loki/pull/2385) **abowloflrf**: Update logo link in README.md 1178* [2378](https://github.com/grafana/loki/pull/2378) **robbymilo**: Sync docs to website 1179* [2360](https://github.com/grafana/loki/pull/2360) **owen-d**: Makes timestamp parsing docs clearer 1180* [2358](https://github.com/grafana/loki/pull/2358) **rille111**: Documentation: Add example for having separate pvc for loki, using helm 1181* [2357](https://github.com/grafana/loki/pull/2357) **owen-d**: Storage backend examples 1182* [2338](https://github.com/grafana/loki/pull/2338) **cyriltovena**: Add a complete tutorial on how to ship logs from AWS EKS. 1183* [2335](https://github.com/grafana/loki/pull/2335) **cyriltovena**: Improve documentation of the metric stage. 1184* [2331](https://github.com/grafana/loki/pull/2331) **cyriltovena**: Add a tutorial to forward AWS ECS logs to Loki. 1185* [2321](https://github.com/grafana/loki/pull/2321) **cyriltovena**: Tutorial to run Promtail on AWS EC2 1186* [2318](https://github.com/grafana/loki/pull/2318) **adityacs**: Configuration documentation improvements 1187* [2317](https://github.com/grafana/loki/pull/2317) **owen-d**: remove DynamoDB chunk store doc 1188* [2308](https://github.com/grafana/loki/pull/2308) **wardbekker**: Added a link to the replace parsing stage 1189* [2305](https://github.com/grafana/loki/pull/2305) **rafaelpissolatto**: Fix schema_config store value 1190* [2285](https://github.com/grafana/loki/pull/2285) **adityacs**: Fix local.md doc 1191* [2284](https://github.com/grafana/loki/pull/2284) **owen-d**: Update local.md 1192* [2279](https://github.com/grafana/loki/pull/2279) **Fra-nk**: Documentation: Refine LogQL documentation 1193* [2273](https://github.com/grafana/loki/pull/2273) **RichiH**: Fix typo 1194* [2247](https://github.com/grafana/loki/pull/2247) **carlpett**: docs: Fix missing quotes 1195* [2233](https://github.com/grafana/loki/pull/2233) **vyzigold**: docs: Add readmes to individual helm charts 1196* [2220](https://github.com/grafana/loki/pull/2220) **oddlittlebird**: Docs: Local install edits 1197* [2217](https://github.com/grafana/loki/pull/2217) **fredr**: docs: BoltDB typo 1198* [2215](https://github.com/grafana/loki/pull/2215) **fredr**: docs: Correct loki address for docker-compose 1199* [2172](https://github.com/grafana/loki/pull/2172) **cyriltovena**: Update old link for pipeline stages. 1200* [2163](https://github.com/grafana/loki/pull/2163) **slim-bean**: docs: fix an error in the example log line and byte counter metrics 1201* [2160](https://github.com/grafana/loki/pull/2160) **slim-bean**: Fix some errors in the upgrade guide to 1.5.0 and add some missing notes discovered by users. 1202* [2152](https://github.com/grafana/loki/pull/2152) **eamonryan**: Fix typo in promtail ClusterRole 1203* [2139](https://github.com/grafana/loki/pull/2139) **adityacs**: Fix configuration docs 1204* [2137](https://github.com/grafana/loki/pull/2137) **RichiH**: Propose new governance 1205* [2136](https://github.com/grafana/loki/pull/2136) **cyriltovena**: Fixes Iterator boundaries 1206* [2125](https://github.com/grafana/loki/pull/2125) **theMercedes**: Update logql.md 1207* [2112](https://github.com/grafana/loki/pull/2112) **nileshcs**: Documentation: Outdated fluentd image name, UID details, link update 1208* [2092](https://github.com/grafana/loki/pull/2092) **i-takizawa**: docs: make <placeholders> visible 1209 1210#### Build 1211* [2467](https://github.com/grafana/loki/pull/2467) **slim-bean**: Update Loki build image 1212 1213#### Ksonnet 1214* [2460](https://github.com/grafana/loki/pull/2460) **Duologic**: refactor: use $.core.v1.envVar 1215* [2452](https://github.com/grafana/loki/pull/2452) **slim-bean**: ksonnet: Reduce querier parallelism to a more sane default value and remove the default setting for storage_backend 1216* [2377](https://github.com/grafana/loki/pull/2377) **Duologic**: refactor: moved jaeger-agent-mixin 1217* [2373](https://github.com/grafana/loki/pull/2373) **slim-bean**: Ksonnet: Add a Pod Disruption Budget to Loki Ingesters 1218* [2185](https://github.com/grafana/loki/pull/2185) **cyriltovena**: Refactor mixin routes and add series API. 1219* [2162](https://github.com/grafana/loki/pull/2162) **slim-bean**: ksonnet: Fix up datasources and variables in Loki Operational 1220* [2091](https://github.com/grafana/loki/pull/2091) **beorn7**: Keep scrape config in line with the new Prometheus scrape config 1221 1222#### Docker logging driver 1223* [2435](https://github.com/grafana/loki/pull/2435) **cyriltovena**: Add more precisions on the docker driver installed on the daemon. 1224* [2343](https://github.com/grafana/loki/pull/2343) **jdfalk**: loki-docker-driver: Change "ignoring empty line" to debug logging 1225* [2295](https://github.com/grafana/loki/pull/2295) **cyriltovena**: Remove mount in the docker driver. 1226* [2199](https://github.com/grafana/loki/pull/2199) **cyriltovena**: Docker driver relabeling 1227* [2116](https://github.com/grafana/loki/pull/2116) **cyriltovena**: Allows to change the log driver mode and buffer size. 1228 1229#### Logstash output plugin 1230* [2415](https://github.com/grafana/loki/pull/2415) **cyriltovena**: Set service values via --set for logstash. 1231* [2410](https://github.com/grafana/loki/pull/2410) **adityacs**: logstash code refactor and doc improvements 1232* [1822](https://github.com/grafana/loki/pull/1822) **adityacs**: Loki Logstash Plugin 1233 1234#### Loki canary 1235* [2413](https://github.com/grafana/loki/pull/2413) **slim-bean**: Loki-Canary: Backoff retries on query failures, add histograms for query performance. 1236* [2369](https://github.com/grafana/loki/pull/2369) **slim-bean**: Loki Canary: One more round of improvements to query for missing websocket entries up to max-wait 1237* [2350](https://github.com/grafana/loki/pull/2350) **slim-bean**: Canary tweaks 1238* [2344](https://github.com/grafana/loki/pull/2344) **slim-bean**: Loki-Canary: Add query spot checking and metric count checking 1239* [2259](https://github.com/grafana/loki/pull/2259) **ombre8**: Canary: make stream configurable 1240 1241#### Fluentd 1242* [2407](https://github.com/grafana/loki/pull/2407) **cyriltovena**: bump fluentd version to release a new gem. 1243* [2399](https://github.com/grafana/loki/pull/2399) **tarokkk**: fluentd: Make fluentd version requirements permissive 1244* [2179](https://github.com/grafana/loki/pull/2179) **takanabe**: Improve fluentd plugin development experience 1245* [2171](https://github.com/grafana/loki/pull/2171) **takanabe**: Add server TLS certificate verification 1246 1247#### Fluent Bit 1248* [2375](https://github.com/grafana/loki/pull/2375) **cyriltovena**: Fixes the fluentbit batchwait backward compatiblity. 1249* [2367](https://github.com/grafana/loki/pull/2367) **dojci**: fluent-bit: Add more loki client configuration options 1250* [2365](https://github.com/grafana/loki/pull/2365) **dojci**: fluent-bit: Fix fluent-bit exit callback when buffering is enabled 1251* [2290](https://github.com/grafana/loki/pull/2290) **cyriltovena**: Fixes the lint issue merged to master. 1252* [2286](https://github.com/grafana/loki/pull/2286) **adityacs**: Fix fluent-bit newline and tab characters 1253* [2142](https://github.com/grafana/loki/pull/2142) **dojci**: Add FIFO queue persistent buffering for fluent bit output plugin 1254* [2089](https://github.com/grafana/loki/pull/2089) **FrederikNS**: Allow configuring more options for output configuration 1255 1256#### Helm 1257* [2406](https://github.com/grafana/loki/pull/2406) **steven-sheehy**: Helm: Fix regression in chart name 1258* [2379](https://github.com/grafana/loki/pull/2379) **StevenReitsma**: production/helm: Add emptyDir volume type to promtail PSP 1259* [2366](https://github.com/grafana/loki/pull/2366) **StevenReitsma**: production/helm: Add projected and downwardAPI volume types to PodSecurityPolicy (#2355) 1260* [2258](https://github.com/grafana/loki/pull/2258) **Synehan**: helm: add annotations to service monitor 1261* [2241](https://github.com/grafana/loki/pull/2241) **chauffer**: Kubernetes manifests: Remove namespace from cluster-wide resources 1262* [2238](https://github.com/grafana/loki/pull/2238) **vhrosales**: helm: Add loadBalancerIP option to loki chart 1263* [2205](https://github.com/grafana/loki/pull/2205) **joschi36**: BUG: add missing namespace in ingress object 1264* [2197](https://github.com/grafana/loki/pull/2197) **cyriltovena**: Render loki datasources even if Grafana is disabled. 1265* [2141](https://github.com/grafana/loki/pull/2141) **cyriltovena**: Adds the ability to have a pull secrets for Promtail. 1266* [2099](https://github.com/grafana/loki/pull/2099) **allout58**: helm/loki-stack: Support Prometheus on a sub-path in Grafana config 1267* [2086](https://github.com/grafana/loki/pull/2086) **osela**: helm/loki-stack: render loki datasource only if grafana is enabled 1268* [2091](https://github.com/grafana/loki/pull/2091) **beorn7**: Keep scrape config in line with the new Prometheus scrape config 1269 1270#### Build 1271* [2371](https://github.com/grafana/loki/pull/2371) **cyriltovena**: Fixes helm publish that needs now to add repo. 1272* [2341](https://github.com/grafana/loki/pull/2341) **slim-bean**: Build: Fix CI helm test 1273* [2309](https://github.com/grafana/loki/pull/2309) **cyriltovena**: Test again arm32 on internal ci. 1274* [2307](https://github.com/grafana/loki/pull/2307) **cyriltovena**: Removes arm32 for now as we're migrating the CI. 1275* [2287](https://github.com/grafana/loki/pull/2287) **wardbekker**: Change the Grafana image to latest 1276* [2212](https://github.com/grafana/loki/pull/2212) **roidelapluie**: Remove unhelpful/problematic term in circleci.yml 1277 1278 1279## 1.5.0 (2020-05-20) 1280 1281It's been a busy month and a half since 1.4.0 was released, and a lot of new improvements have been added to Loki since! 1282 1283Be prepared for some configuration changes that may cause some bumps when upgrading, 1284we apologize for this but are always striving to reach the right compromise of code simplicity and user/operating experience. 1285 1286In this case we opted to keep a simplified configuration inline with Cortex rather than a more complicated and error prone internal config mapping or difficult to implement support for multiple config names for the same feature. 1287 1288This does result in breaking config changes for some configurations, however, these will fail fast and with the [list of diffs](https://cortexmetrics.io/docs/changelog/#config-file-breaking-changes) from the Cortex project should be quick to fix. 1289 1290### Important Notes 1291 1292**Be prepared for breaking config changes.** Loki 1.5.0 vendors cortex [v1.0.1-0.20200430170006-3462eb63f324](https://github.com/cortexproject/cortex/commit/3462eb63f324c649bbaa122933bc591b710f4e48), 1293there were substantial breaking config changes in Cortex 1.0 which standardized config options, and fixed typos. 1294 1295**The Loki docker image user has changed to no longer be root** 1296 1297Check the [upgrade guide](https://github.com/grafana/loki/blob/master/docs/sources/operations/upgrade.md#150) for more detailed information on these changes. 1298 1299### Notable Features and Fixes 1300 1301There are quite a few we want to mention listed in order they were merged (mostly) 1302 1303* [1837](https://github.com/grafana/loki/pull/1837) **sandeepsukhani**: flush boltdb to object store 1304 1305This is perhaps the most exciting feature of 1.5.0, the first steps in removing a dependency on a separate index store! This feature is still very new and experimental, however, we want this to be the future for Loki. Only requiring just an object store. 1306 1307If you want to test this new feature, and help us find any bugs, check out the [docs](docs/operations/storage/boltdb-shipper.md) to learn more and get started. 1308 1309* [2073](https://github.com/grafana/loki/pull/2073) **slim-bean**: Loki: Allow configuring query_store_max_look_back_period when running a filesystem store and boltdb-shipper 1310 1311This is even more experimental than the previous feature mentioned however also pretty exciting for Loki users who use the filesystem storage. We can leverage changes made in [1837](https://github.com/grafana/loki/pull/1837) to now allow Loki to run in a clustered mode with individual filesystem stores! 1312 1313Please check out the last section in the [filesystem docs](docs/operations/storage/filesystem.md) for more details on how this works and how to use it! 1314 1315* [2095](https://github.com/grafana/loki/pull/2095) **cyriltovena**: Adds backtick for the quoted string token lexer. 1316 1317This will come as a big win to anyone who is writing complicated reqular expressions in either their Label matchers or Filter Expressions. Starting now you can use the backtick to encapsulate your regex **and not have to do any escaping of special characters!!** 1318 1319Examples: 1320 1321``` 1322{name="cassandra"} |~ `error=\w+` 1323{name!~`mysql-\d+`} 1324``` 1325 1326* [2055](https://github.com/grafana/loki/pull/2055) **aknuds1**: Chore: Fix spelling of per second in code 1327 1328This is technically a breaking change for anyone who wrote code to processes the new statistics output in the query result added in 1.4.0, we apologize to anyone in this situation but if we don't fix this kind of error now it will be there forever. 1329And at the same time we didn't feel it was appropriate to make any major api revision changes for such a new feature and simple change. We are always trying to use our best judgement in cases like this. 1330 1331* [2031](https://github.com/grafana/loki/pull/2031) **cyriltovena**: Improve protobuf serialization 1332 1333Thanks @cyriltovena for another big performance improvement in Loki, this time around protbuf's! 1334 1335* [2021](https://github.com/grafana/loki/pull/2021) **slim-bean**: Loki: refactor validation and improve error messages 1336* [2012](https://github.com/grafana/loki/pull/2012) **slim-bean**: Loki: Improve logging and add metrics to streams dropped by stream limit 1337 1338These two changes standardize the metrics used to report when a tenant hits a limit, now all discarded samples should be reported under `loki_discarded_samples_total` and you no longer need to also reference `cortex_discarded_samples_total`. 1339Additionally error messages were improved to help clients take better action when hitting limits. 1340 1341* [1970](https://github.com/grafana/loki/pull/1970) **cyriltovena**: Allow to aggregate binary operations. 1342 1343Another nice improvement to the query language which allows queries like this to work now: 1344 1345``` 1346sum by (job) (count_over_time({namespace="tns"}[5m] |= "level=error") / count_over_time({namespace="tns"}[5m])) 1347``` 1348 1349* [1713](https://github.com/grafana/loki/pull/1713) **adityacs**: Log error message for invalid checksum 1350 1351In the event something went wrong with a stored chunk, rather than fail the query we ignore the chunk and return the rest. 1352 1353* [2066](https://github.com/grafana/loki/pull/2066) **slim-bean**: Promtail: metrics stage can also count line bytes 1354 1355This is a nice extension to a previous feature which let you add a metric to count log lines per stream, you can now count log bytes per stream. 1356 1357Check out [this example](docs/clients/promtail/configuration.md#counter) to configure this in your promtail pipelines. 1358 1359* [1935](https://github.com/grafana/loki/pull/1935) **cyriltovena**: Support stdin target via flag instead of automatic detection. 1360 1361Third times a charm! With 1.4.0 we allowed sending logs directly to promtail via stdin, with 1.4.1 we released a patch for this feature which wasn't detecting stdin correctly on some operating systems. 1362Unfortunately after a few more bug reports it seems this change caused some more undesired side effects so we decided to not try to autodetect stdin at all, instead now you must pass the `--stdin` flag if you want Promtail to listen for logs on stdin. 1363 1364* [2076](https://github.com/grafana/loki/pull/2076) **cyriltovena**: Allows to pass inlined pipeline stages to the docker driver. 1365* [1906](https://github.com/grafana/loki/pull/1906) **cyriltovena**: Add no-file and keep-file log option for docker driver. 1366 1367The docker logging driver received a couple very nice updates, it's always been challenging to configure pipeline stages for the docker driver, with the first PR there are now a few easier ways to do this! 1368In the second PR we added config options to control keeping any log files on the host when using the docker logging driver, allowing you to run with no disk access if you would like, as well as allowing you to control keeping log files available after container restarts. 1369 1370** [1864](https://github.com/grafana/loki/pull/1864) **cyriltovena**: Sign helm package with GPG. 1371 1372We now GPG sign helm packages! 1373 1374### All Changes 1375 1376#### Loki 1377 1378* [2097](https://github.com/grafana/loki/pull/2097) **owen-d**: simplifies/updates some of our configuration examples 1379* [2095](https://github.com/grafana/loki/pull/2095) **cyriltovena**: Adds backtick for the quoted string token lexer. 1380* [2093](https://github.com/grafana/loki/pull/2093) **cyriltovena**: Fixes unit in stats request log. 1381* [2088](https://github.com/grafana/loki/pull/2088) **slim-bean**: Loki: allow no encoding/compression on chunks 1382* [2078](https://github.com/grafana/loki/pull/2078) **owen-d**: removes yolostring 1383* [2073](https://github.com/grafana/loki/pull/2073) **slim-bean**: Loki: Allow configuring query_store_max_look_back_period when running a filesystem store and boltdb-shipper 1384* [2064](https://github.com/grafana/loki/pull/2064) **cyriltovena**: Reverse entry iterator pool 1385* [2059](https://github.com/grafana/loki/pull/2059) **cyriltovena**: Recover from panic in http and grpc handlers. 1386* [2058](https://github.com/grafana/loki/pull/2058) **cyriltovena**: Fix a bug in range vector skipping data. 1387* [2055](https://github.com/grafana/loki/pull/2055) **aknuds1**: Chore: Fix spelling of per second in code 1388* [2046](https://github.com/grafana/loki/pull/2046) **gouthamve**: Fix bug in logql parsing that leads to crash. 1389* [2050](https://github.com/grafana/loki/pull/2050) **aknuds1**: Chore: Correct typo "per seconds" 1390* [2034](https://github.com/grafana/loki/pull/2034) **sandeepsukhani**: some metrics for measuring performance and failures in boltdb shipper 1391* [2031](https://github.com/grafana/loki/pull/2031) **cyriltovena**: Improve protobuf serialization 1392* [2030](https://github.com/grafana/loki/pull/2030) **adityacs**: Update loki to cortex master 1393* [2023](https://github.com/grafana/loki/pull/2023) **cyriltovena**: Support post requests in the frontend queryrange handler. 1394* [2021](https://github.com/grafana/loki/pull/2021) **slim-bean**: Loki: refactor validation and improve error messages 1395* [2019](https://github.com/grafana/loki/pull/2019) **slim-bean**: make `loki_ingester_memory_streams` Gauge per tenant. 1396* [2012](https://github.com/grafana/loki/pull/2012) **slim-bean**: Loki: Improve logging and add metrics to streams dropped by stream limit 1397* [2010](https://github.com/grafana/loki/pull/2010) **cyriltovena**: Update lz4 library to latest to ensure deterministic output. 1398* [2001](https://github.com/grafana/loki/pull/2001) **sandeepsukhani**: table client for boltdb shipper to enforce retention 1399* [1995](https://github.com/grafana/loki/pull/1995) **sandeepsukhani**: make boltdb shipper singleton and some other minor refactoring 1400* [1987](https://github.com/grafana/loki/pull/1987) **slim-bean**: Loki: Add a missing method to facade which is called by the metrics storage client in cortex 1401* [1982](https://github.com/grafana/loki/pull/1982) **cyriltovena**: Update cortex to latest. 1402* [1977](https://github.com/grafana/loki/pull/1977) **cyriltovena**: Ensure trace propagation in our logs. 1403* [1976](https://github.com/grafana/loki/pull/1976) **slim-bean**: incorporate some better defaults into table-manager configs 1404* [1975](https://github.com/grafana/loki/pull/1975) **slim-bean**: Update cortex vendoring to latest master 1405* [1970](https://github.com/grafana/loki/pull/1970) **cyriltovena**: Allow to aggregate binary operations. 1406* [1965](https://github.com/grafana/loki/pull/1965) **slim-bean**: Loki: Adds an `interval` paramater to query_range queries allowing a sampling of events to be returned based on the provided interval 1407* [1964](https://github.com/grafana/loki/pull/1964) **owen-d**: chunk bounds metric now records 8h range in 1h increments 1408* [1963](https://github.com/grafana/loki/pull/1963) **cyriltovena**: Improve the local config to work locally and inside docker. 1409* [1961](https://github.com/grafana/loki/pull/1961) **jpmcb**: [Bug] Workaround for broken etcd gomod import 1410* [1958](https://github.com/grafana/loki/pull/1958) **owen-d**: chunk lifespan histogram 1411* [1956](https://github.com/grafana/loki/pull/1956) **sandeepsukhani**: update cortex to latest master 1412* [1953](https://github.com/grafana/loki/pull/1953) **jpmcb**: Go mod: explicit golang.org/x/net replace 1413* [1950](https://github.com/grafana/loki/pull/1950) **cyriltovena**: Fixes case handling in regex simplification. 1414* [1949](https://github.com/grafana/loki/pull/1949) **SerialVelocity**: [Loki]: Cleanup dockerfile 1415* [1946](https://github.com/grafana/loki/pull/1946) **slim-bean**: Loki Update the cut block size counter when creating a memchunk from byte slice 1416* [1939](https://github.com/grafana/loki/pull/1939) **owen-d**: adds config validation, similar to cortex 1417* [1916](https://github.com/grafana/loki/pull/1916) **cyriltovena**: Add cap_net_bind_service linux capabilities to Loki. 1418* [1914](https://github.com/grafana/loki/pull/1914) **owen-d**: only fetches one chunk per series in /series 1419* [1875](https://github.com/grafana/loki/pull/1875) **owen-d**: support `match[]` encoding 1420* [1869](https://github.com/grafana/loki/pull/1869) **pstibrany**: Update Cortex to latest master 1421* [1846](https://github.com/grafana/loki/pull/1846) **owen-d**: Sharding optimizations I: AST mapping 1422* [1838](https://github.com/grafana/loki/pull/1838) **cyriltovena**: Move default port for Loki to 3100 everywhere. 1423* [1837](https://github.com/grafana/loki/pull/1837) **sandeepsukhani**: flush boltdb to object store 1424* [1834](https://github.com/grafana/loki/pull/1834) **Mario-Hofstaetter**: Loki/Change local storage directory to /loki/ and fix permissions (#1833) 1425* [1819](https://github.com/grafana/loki/pull/1819) **cyriltovena**: Adds a counter for total flushed chunks per reason. 1426* [1816](https://github.com/grafana/loki/pull/1816) **sdojjy**: loki can not be started with loki-local-config.yaml 1427* [1810](https://github.com/grafana/loki/pull/1810) **cyriltovena**: Optimize empty filter queries. 1428* [1809](https://github.com/grafana/loki/pull/1809) **cyriltovena**: Test stats memchunk 1429* [1804](https://github.com/grafana/loki/pull/1804) **pstibrany**: Convert Loki modules to services 1430* [1799](https://github.com/grafana/loki/pull/1799) **pstibrany**: loki: update Cortex to master 1431* [1798](https://github.com/grafana/loki/pull/1798) **adityacs**: Support configurable maximum of the limits parameter 1432* [1713](https://github.com/grafana/loki/pull/1713) **adityacs**: Log error message for invalid checksum 1433* [1706](https://github.com/grafana/loki/pull/1706) **cyriltovena**: Non-root user docker image for Loki. 1434 1435#### Logcli 1436* [2027](https://github.com/grafana/loki/pull/2027) **pstibrany**: logcli: Query needs to be stored into url.RawQuery, and not url.Path 1437* [2000](https://github.com/grafana/loki/pull/2000) **cyriltovena**: Improve URL building in the logcli to strip trailing /. 1438* [1922](https://github.com/grafana/loki/pull/1922) **bavarianbidi**: logcli: org-id/tls-skip-verify set via env var 1439* [1861](https://github.com/grafana/loki/pull/1861) **yeya24**: Support series API in logcli 1440* [1850](https://github.com/grafana/loki/pull/1850) **chrischdi**: BugFix: Fix logcli client to use OrgID in LiveTail 1441* [1814](https://github.com/grafana/loki/pull/1814) **cyriltovena**: Logcli remote storage. 1442* [1712](https://github.com/grafana/loki/pull/1712) **rfratto**: clarify logcli commands and output 1443 1444#### Promtail 1445* [2069](https://github.com/grafana/loki/pull/2069) **slim-bean**: Promtail: log at debug level when nothing matches the specified path for a file target 1446* [2066](https://github.com/grafana/loki/pull/2066) **slim-bean**: Promtail: metrics stage can also count line bytes 1447* [2049](https://github.com/grafana/loki/pull/2049) **adityacs**: Fix promtail client default values 1448* [2075](https://github.com/grafana/loki/pull/2075) **cyriltovena**: Fixes a panic in dry-run when using external labels. 1449* [2026](https://github.com/grafana/loki/pull/2026) **adityacs**: Targets not required in promtail config 1450* [2004](https://github.com/grafana/loki/pull/2004) **cyriltovena**: Adds config to disable HTTP and GRPC server in Promtail. 1451* [1935](https://github.com/grafana/loki/pull/1935) **cyriltovena**: Support stdin target via flag instead of automatic detection. 1452* [1920](https://github.com/grafana/loki/pull/1920) **alexanderGalushka**: feat: tms readiness check bypass implementation 1453* [1894](https://github.com/grafana/loki/pull/1894) **cyriltovena**: Fixes possible panic in json pipeline stage. 1454* [1865](https://github.com/grafana/loki/pull/1865) **adityacs**: Fix flaky promtail test 1455* [1815](https://github.com/grafana/loki/pull/1815) **adityacs**: Log error message when source does not exist in extracted values 1456* [1627](https://github.com/grafana/loki/pull/1627) **rfratto**: Proposal: Promtail Push API 1457 1458#### Docker Driver 1459* [2076](https://github.com/grafana/loki/pull/2076) **cyriltovena**: Allows to pass inlined pipeline stages to the docker driver. 1460* [2054](https://github.com/grafana/loki/pull/2054) **bkmit**: Docker driver: Allow to provision external pipeline files to plugin 1461* [1906](https://github.com/grafana/loki/pull/1906) **cyriltovena**: Add no-file and keep-file log option for docker driver. 1462* [1903](https://github.com/grafana/loki/pull/1903) **cyriltovena**: Log docker driver config map. 1463 1464#### Fluentd 1465* [2074](https://github.com/grafana/loki/pull/2074) **osela**: fluentd plugin: support placeholders in tenant field 1466* [2006](https://github.com/grafana/loki/pull/2006) **Skeen**: fluent-plugin-loki: Restructuring and CI 1467* [1909](https://github.com/grafana/loki/pull/1909) **jgehrcke**: fluentd loki plugin README: add note about labels 1468* [1853](https://github.com/grafana/loki/pull/1853) **wardbekker**: bump gem version 1469* [1811](https://github.com/grafana/loki/pull/1811) **JamesJJ**: Error handling: Show data stream at "debug" level, not "warn" 1470 1471#### Fluent Bit 1472* [2040](https://github.com/grafana/loki/pull/2040) **avii-ridge**: Add extraOutputs variable to support multiple outputs for fluent-bit 1473* [1915](https://github.com/grafana/loki/pull/1915) **DirtyCajunRice**: Fix fluent-bit metrics 1474* [1890](https://github.com/grafana/loki/pull/1890) **dottedmag**: fluentbit: JSON encoding: avoid base64 encoding of []byte inside other slices 1475* [1791](https://github.com/grafana/loki/pull/1791) **cyriltovena**: Improve fluentbit logfmt. 1476 1477#### Ksonnet 1478* [1980](https://github.com/grafana/loki/pull/1980) **cyriltovena**: Log slow query from the frontend by default in ksonnet. 1479 1480##### Mixins 1481* [2080](https://github.com/grafana/loki/pull/2080) **beorn7**: mixin: Accept suffixes to pod name in instance labels 1482* [2044](https://github.com/grafana/loki/pull/2044) **slim-bean**: Dashboards: fixes the cpu usage graphs 1483* [2043](https://github.com/grafana/loki/pull/2043) **joe-elliott**: Swapped to container restarts over terminated reasons 1484* [2041](https://github.com/grafana/loki/pull/2041) **slim-bean**: Dashboard: Loki Operational improvements 1485* [1934](https://github.com/grafana/loki/pull/1934) **tomwilkie**: Put loki-mixin and promtail-mixin dashboards in a folder. 1486* [1913](https://github.com/grafana/loki/pull/1913) **tomwilkie**: s/dashboards/grafanaDashboards. 1487 1488#### Helm 1489* [2038](https://github.com/grafana/loki/pull/2038) **oke-py**: Docs: update Loki Helm Chart document to support Helm 3 1490* [2015](https://github.com/grafana/loki/pull/2015) **etashsingh**: Change image tag from 1.4.1 to 1.4.0 in Helm chart 1491* [1981](https://github.com/grafana/loki/pull/1981) **sshah90**: added extraCommandlineArgs in values file 1492* [1967](https://github.com/grafana/loki/pull/1967) **rdxmb**: helm chart: add missing line feed 1493* [1898](https://github.com/grafana/loki/pull/1898) **stefanandres**: [helm loki/promtail] make UpdateStrategy configurable 1494* [1871](https://github.com/grafana/loki/pull/1871) **stefanandres**: [helm loki/promtail] Add systemd-journald example with extraMount, extraVolumeMount 1495* [1864](https://github.com/grafana/loki/pull/1864) **cyriltovena**: Sign helm package with GPG. 1496* [1825](https://github.com/grafana/loki/pull/1825) **polar3130**: Helm/loki-stack: refresh default grafana.image.tag to 6.7.0 1497* [1817](https://github.com/grafana/loki/pull/1817) **bclermont**: Helm chart: Prevent prometheus to scrape both services 1498 1499#### Loki Canary 1500* [1891](https://github.com/grafana/loki/pull/1891) **joe-elliott**: Addition of a `/suspend` endpoint to Loki Canary 1501 1502#### Docs 1503* [2056](https://github.com/grafana/loki/pull/2056) **cyriltovena**: Update api.md 1504* [2014](https://github.com/grafana/loki/pull/2014) **jsoref**: Spelling 1505* [1999](https://github.com/grafana/loki/pull/1999) **oddlittlebird**: Docs: Added labels content 1506* [1974](https://github.com/grafana/loki/pull/1974) **rfratto**: fix stores for chunk and index in documentation for period_config 1507* [1966](https://github.com/grafana/loki/pull/1966) **oddlittlebird**: Docs: Update docker.md 1508* [1951](https://github.com/grafana/loki/pull/1951) **cstyan**: Move build from source instructions to root readme. 1509* [1945](https://github.com/grafana/loki/pull/1945) **FlorianLudwig**: docs: version pin the docker image in docker-compose 1510* [1925](https://github.com/grafana/loki/pull/1925) **wardbekker**: Clarified that the api push path needs to be specified. 1511* [1905](https://github.com/grafana/loki/pull/1905) **sshah90**: updating typo for end time parameter in api docs 1512* [1888](https://github.com/grafana/loki/pull/1888) **slim-bean**: docs: cleaning up the comments for the cache_config, default_validity option 1513* [1887](https://github.com/grafana/loki/pull/1887) **slim-bean**: docs: Adding a config change in release 1.4 upgrade doc, updating readme with new doc links 1514* [1881](https://github.com/grafana/loki/pull/1881) **cyriltovena**: Add precision about the range notation for LogQL. 1515* [1879](https://github.com/grafana/loki/pull/1879) **slim-bean**: docs: update promtail docs for backoff 1516* [1873](https://github.com/grafana/loki/pull/1873) **owen-d**: documents frontend worker 1517* [1870](https://github.com/grafana/loki/pull/1870) **ushuz**: Docs: Keep plugin install command example in one line 1518* [1856](https://github.com/grafana/loki/pull/1856) **slim-bean**: docs: tweak the doc section of the readme a little 1519* [1852](https://github.com/grafana/loki/pull/1852) **slim-bean**: docs: clean up schema recommendations 1520* [1843](https://github.com/grafana/loki/pull/1843) **vishesh92**: Docs: Update configuration docs for redis 1521 1522#### Build 1523* [2042](https://github.com/grafana/loki/pull/2042) **rfratto**: Fix drone 1524* [2009](https://github.com/grafana/loki/pull/2009) **cyriltovena**: Adds :delegated flags to speed up build experience on MacOS. 1525* [1942](https://github.com/grafana/loki/pull/1942) **owen-d**: delete tag script filters by prefix instead of substring 1526* [1918](https://github.com/grafana/loki/pull/1918) **slim-bean**: build: This Dockerfile is a remnant from a long time ago, not needed. 1527* [1911](https://github.com/grafana/loki/pull/1911) **slim-bean**: build: push images for `k` branches 1528* [1849](https://github.com/grafana/loki/pull/1849) **cyriltovena**: Pin helm version in circle-ci helm testing workflow. 1529 1530 1531## 1.4.1 (2020-04-06) 1532 1533We realized after the release last week that piping data into promtail was not working on Linux or Windows, this should fix this issue for both platforms: 1534 1535* [1893](https://github.com/grafana/loki/pull/1893) **cyriltovena**: Removes file size check for pipe, not provided by linux. 1536 1537Also thanks to @dottedmag for providing this fix for Fluent Bit! 1538 1539* [1890](https://github.com/grafana/loki/pull/1890) **dottedmag**: fluentbit: JSON encoding: avoid base64 encoding of []byte inside other slices 1540 1541## 1.4.0 (2020-04-01) 1542 1543Over 130 PR's merged for this release, from 40 different contributors!! We continue to be humbled and thankful for the growing community of contributors and users of Loki. Thank you all so much. 1544 1545### Important Notes 1546 1547**Really, this is important** 1548 1549Before we get into new features, version 1.4.0 brings with it the first (that we are aware of) upgrade dependency. 1550 1551We have created a dedicated page for upgrading Loki in the [operations section of the docs](https://github.com/grafana/loki/blob/master/docs/sources/operations/upgrade.md#140) 1552 1553The docker image tag naming was changed, the starting in 1.4.0 docker images no longer have the `v` prefix: `grafana/loki:1.4.0` 1554 1555Also you should be aware we are now pruning old `master-xxxxx` docker images from docker hub, currently anything older than 90 days is removed. **We will never remove released versions of Loki** 1556 1557### Notable Features 1558 1559* [1661](https://github.com/grafana/loki/pull/1661) **cyriltovena**: Frontend & Querier query statistics instrumentation. 1560 1561The API now returns a plethora of stats into the work Loki performed to execute your query, eventually this will be displayed in some form in Grafana to help users better understand how "expensive" their queries are. Our goal here initially was to better instrument the recent work done in v1.3.0 on query parallelization and to better understand the performance of each part of Loki. In the future we are looking at additional ideas to provide feedback to users to tailor their queries for better performance. 1562 1563* [1652](https://github.com/grafana/loki/pull/1652) **cyriltovena**: --dry-run Promtail. 1564* [1649](https://github.com/grafana/loki/pull/1649) **cyriltovena**: Pipe data to Promtail 1565 1566This is a long overdue addition to Promtail which can help setup and debug pipelines, with these new features you can do this to feed a single log line into Promtail: 1567 1568```bash 1569echo -n 'level=debug msg="test log (200)"' | cmd/promtail/promtail -config.file=cmd/promtail/promtail-local-config.yaml --dry-run -log.level=debug 2>&1 | sed 's/^.*stage/stage/g' 1570``` 1571 1572`-log.level=debug 2>&1 | sed 's/^.*stage/stage/g` are added to enable debug output, direct the output to stdout, and a sed filter to remove some noise from the log lines. 1573 1574The `stdin` functionality also works without `--dry-run` allowing you to feed any logs into Promtail via `stdin` and send them to Loki 1575 1576* [1677](https://github.com/grafana/loki/pull/1677) **owen-d**: Literal Expressions in LogQL 1577* [1662](https://github.com/grafana/loki/pull/1662) **owen-d**: Binary operators in LogQL 1578 1579These two extensions to LogQL now let you execute queries like this: 1580 1581 * `sum(rate({app="foo"}[5m])) * 2` 1582 * `sum(rate({app="foo"}[5m]))/1e6` 1583 1584* [1678](https://github.com/grafana/loki/pull/1678) **slim-bean**: promtail: metrics pipeline count all log lines 1585 1586Now you can get per-stream line counts as a metric from promtail, useful for seeing which applications log the most 1587 1588```yaml 1589- metrics: 1590 line_count_total: 1591 config: 1592 action: inc 1593 match_all: true 1594 description: A running counter of all lines with their corresponding 1595 labels 1596 type: Counter 1597``` 1598 1599* [1558](https://github.com/grafana/loki/pull/1558) **owen-d**: ingester.max-chunk-age 1600* [1572](https://github.com/grafana/loki/pull/1572) **owen-d**: Feature/query ingesters within 1601 1602These two configs let you set the max time a chunk can stay in memory in Loki, this is useful to keep memory usage down as well as limit potential loss of data if ingesters crash. Combine this with the `query_ingesters_within` config and you can have your queriers skip asking the ingesters for data which you know won't still be in memory (older than max_chunk_age). 1603 1604**NOTE** Do not set the `max_chunk_age` too small, the default of 1h is probably a good point for most people. Loki does not perform well when you flush many small chunks (such as when your logs have too much cardinality), setting this lower than 1h risks flushing too many small chunks. 1605 1606* [1581](https://github.com/grafana/loki/pull/1581) **slim-bean**: Add sleep to canary reconnect on error 1607 1608This isn't a feature but it's an important fix, this is the second time our canaries have tried to DDOS our Loki clusters so you should update to prevent them from trying to attack you. Aggressive little things these canaries... 1609 1610* [1840](https://github.com/grafana/loki/pull/1840) **slim-bean**: promtail: Retry 429 rate limit errors from Loki, increase default retry limits 1611* [1845](https://github.com/grafana/loki/pull/1845) **wardbekker**: throw exceptions on HTTPTooManyRequests and HTTPServerError so Fluentd will retry 1612 1613These two PR's change how 429 HTTP Response codes are handled (Rate Limiting), previously these responses were dropped, now they will be retried for these clients 1614 1615 * Promtail 1616 * Docker logging driver 1617 * Fluent Bit 1618 * Fluentd 1619 1620This pushes the failure to send logs to two places. First is the retry limits. The defaults in promtail (and thus also the Docker logging driver and Fluent Bit, which share the same underlying code) will retry 429s (and 500s) on an exponential backoff for up to about 8.5 mins on the default configurations. (This can be changed; see the [config docs](https://github.com/grafana/loki/blob/v1.4.0/docs/clients/promtail/configuration.md#client_config) for more info.) 1621 1622The second place would be the log file itself. At some point, most log files roll based on size or time. Promtail makes an attempt to read a rolled log file but will only try once. If you are very sensitive to lost logs, give yourself really big log files with size-based rolling rules and increase those retry timeouts. This should protect you from Loki server outages or network issues. 1623 1624### All Changes 1625 1626There are many other important fixes and improvements to Loki, way too many to call out in individual detail, so take a look! 1627 1628#### Loki 1629* [1810](https://github.com/grafana/loki/pull/1810) **cyriltovena**: Optimize empty filter queries. 1630* [1809](https://github.com/grafana/loki/pull/1809) **cyriltovena**: Test stats memchunk 1631* [1807](https://github.com/grafana/loki/pull/1807) **pracucci**: Enable global limits by default in production mixin 1632* [1802](https://github.com/grafana/loki/pull/1802) **cyriltovena**: Add a test for duplicates count in the heap iterator and fixes it. 1633* [1799](https://github.com/grafana/loki/pull/1799) **pstibrany**: loki: update Cortex to master 1634* [1797](https://github.com/grafana/loki/pull/1797) **cyriltovena**: Use ingester client GRPC call options from config. 1635* [1794](https://github.com/grafana/loki/pull/1794) **pstibrany**: loki: Convert module names to string 1636* [1793](https://github.com/grafana/loki/pull/1793) **johncming**: pkg/chunkenc: fix leak of pool. 1637* [1789](https://github.com/grafana/loki/pull/1789) **adityacs**: Fix loki exit on jaeger agent not being present 1638* [1787](https://github.com/grafana/loki/pull/1787) **cyriltovena**: Regexp simplification 1639* [1785](https://github.com/grafana/loki/pull/1785) **pstibrany**: Update Cortex to master 1640* [1758](https://github.com/grafana/loki/pull/1758) **cyriltovena**: Query range should not support date where start == end. 1641* [1750](https://github.com/grafana/loki/pull/1750) **talham7391**: Clearer error response from push endpoint when labels are malformed 1642* [1746](https://github.com/grafana/loki/pull/1746) **cyriltovena**: Update cortex vendoring to include frontend status code improvement. 1643* [1745](https://github.com/grafana/loki/pull/1745) **cyriltovena**: Refactor querier http error handling. 1644* [1736](https://github.com/grafana/loki/pull/1736) **adityacs**: Add /ready endpoint to table-manager 1645* [1733](https://github.com/grafana/loki/pull/1733) **cyriltovena**: This logs queries with latency tag when recording stats. 1646* [1730](https://github.com/grafana/loki/pull/1730) **adityacs**: Fix nil pointer dereference in ingester client 1647* [1719](https://github.com/grafana/loki/pull/1719) **cyriltovena**: Expose QueryType function. 1648* [1718](https://github.com/grafana/loki/pull/1718) **cyriltovena**: Better logql metric status code. 1649* [1708](https://github.com/grafana/loki/pull/1708) **cyriltovena**: Increase discarded samples when line is too long. 1650* [1704](https://github.com/grafana/loki/pull/1704) **owen-d**: api support for scalars 1651* [1686](https://github.com/grafana/loki/pull/1686) **owen-d**: max line lengths (component + tenant overrides) 1652* [1684](https://github.com/grafana/loki/pull/1684) **cyriltovena**: Ensure status codes are set correctly in the frontend. 1653* [1677](https://github.com/grafana/loki/pull/1677) **owen-d**: Literal Expressions in LogQL 1654* [1662](https://github.com/grafana/loki/pull/1662) **owen-d**: Binary operators in LogQL 1655* [1661](https://github.com/grafana/loki/pull/1661) **cyriltovena**: Frontend & Querier query statistics instrumentation. 1656* [1651](https://github.com/grafana/loki/pull/1651) **owen-d**: removes duplicate logRangeExprExt grammar 1657* [1636](https://github.com/grafana/loki/pull/1636) **cyriltovena**: Fixes stats summary computation. 1658* [1630](https://github.com/grafana/loki/pull/1630) **owen-d**: adds stringer methods for all ast expr types 1659* [1626](https://github.com/grafana/loki/pull/1626) **owen-d**: compiler guarantees for logql exprs 1660* [1616](https://github.com/grafana/loki/pull/1616) **owen-d**: cache key cant be reused when an interval changes 1661* [1615](https://github.com/grafana/loki/pull/1615) **cyriltovena**: Add statistics to query_range and instant_query API. 1662* [1612](https://github.com/grafana/loki/pull/1612) **owen-d**: bumps cortex to 0.6.1 master 1663* [1605](https://github.com/grafana/loki/pull/1605) **owen-d**: Decouple logql engine/AST from execution context 1664* [1582](https://github.com/grafana/loki/pull/1582) **slim-bean**: Change new stats names 1665* [1579](https://github.com/grafana/loki/pull/1579) **rfratto**: Disable transfers in loki-local-config.yaml 1666* [1572](https://github.com/grafana/loki/pull/1572) **owen-d**: Feature/query ingesters within 1667* [1677](https://github.com/grafana/loki/pull/1677) **owen-d**: Introduces numeric literals in LogQL 1668* [1569](https://github.com/grafana/loki/pull/1569) **owen-d**: refactors splitby to not require buffered channels 1669* [1567](https://github.com/grafana/loki/pull/1567) **owen-d**: adds span metadata for split queries 1670* [1565](https://github.com/grafana/loki/pull/1565) **owen-d**: Feature/per tenant splitby 1671* [1562](https://github.com/grafana/loki/pull/1562) **sandeepsukhani**: limit for concurrent tail requests 1672* [1558](https://github.com/grafana/loki/pull/1558) **owen-d**: ingester.max-chunk-age 1673* [1484](https://github.com/grafana/loki/pull/1484) **pstibrany**: loki: use new runtimeconfig package from Cortex 1674 1675#### Promtail 1676* [1840](https://github.com/grafana/loki/pull/1840) **slim-bean**: promtail: Retry 429 rate limit errors from Loki, increase default retry limits 1677* [1775](https://github.com/grafana/loki/pull/1775) **slim-bean**: promtail: remove the read lines counter when the log file stops being tailed 1678* [1770](https://github.com/grafana/loki/pull/1770) **adityacs**: Fix single job with multiple service discovery elements 1679* [1765](https://github.com/grafana/loki/pull/1765) **adityacs**: Fix error in templating when extracted key has nil value 1680* [1743](https://github.com/grafana/loki/pull/1743) **dtennander**: Promtail: Ignore dropped entries in subsequent metric-stages in pipelines. 1681* [1687](https://github.com/grafana/loki/pull/1687) **adityacs**: Fix panic in labels debug message 1682* [1683](https://github.com/grafana/loki/pull/1683) **slim-bean**: promtail: auto-prune stale metrics 1683* [1678](https://github.com/grafana/loki/pull/1678) **slim-bean**: promtail: metrics pipeline count all log lines 1684* [1666](https://github.com/grafana/loki/pull/1666) **adityacs**: Support entire extracted value map in template pipeline stage 1685* [1664](https://github.com/grafana/loki/pull/1664) **adityacs**: Support custom prefix name in metrics stage 1686* [1660](https://github.com/grafana/loki/pull/1660) **rfratto**: pkg/promtail/positions: handle empty positions file 1687* [1652](https://github.com/grafana/loki/pull/1652) **cyriltovena**: --dry-run Promtail. 1688* [1649](https://github.com/grafana/loki/pull/1649) **cyriltovena**: Pipe data to Promtail 1689* [1602](https://github.com/grafana/loki/pull/1602) **slim-bean**: Improve promtail configuration docs 1690 1691#### Helm 1692* [1731](https://github.com/grafana/loki/pull/1731) **billimek**: [promtail helm chart] - Expand promtail syslog svc to support values 1693* [1688](https://github.com/grafana/loki/pull/1688) **fredgate**: Loki stack helm chart can deploy datasources without Grafana 1694* [1632](https://github.com/grafana/loki/pull/1632) **lukipro**: Added support for imagePullSecrets in Loki Helm chart 1695* [1620](https://github.com/grafana/loki/pull/1620) **rsteneteg**: [promtail helm chart] option to set fs.inotify.max_user_instances with init container 1696* [1617](https://github.com/grafana/loki/pull/1617) **billimek**: [promtail helm chart] Enable support for syslog service 1697* [1590](https://github.com/grafana/loki/pull/1590) **polar3130**: Helm/loki-stack: refresh default grafana.image.tag to 6.6.0 1698* [1587](https://github.com/grafana/loki/pull/1587) **polar3130**: Helm/loki-stack: add template for the service name to connect to loki 1699* [1585](https://github.com/grafana/loki/pull/1585) **monotek**: [loki helm chart] added ingress 1700* [1553](https://github.com/grafana/loki/pull/1553) **got-root**: helm: Allow setting 'loadBalancerSourceRanges' for the loki service 1701* [1529](https://github.com/grafana/loki/pull/1529) **tourea**: Promtail Helm Chart: Add support for passing environment variables 1702 1703#### Jsonnet 1704* [1776](https://github.com/grafana/loki/pull/1776) **Eraac**: fix typo: Not a binary operator: = 1705* [1767](https://github.com/grafana/loki/pull/1767) **joe-elliott**: Dashboard Cleanup 1706* [1766](https://github.com/grafana/loki/pull/1766) **joe-elliott**: Move dashboards out into their own json files 1707* [1757](https://github.com/grafana/loki/pull/1757) **slim-bean**: promtail-mixin: Allow choosing promtail name 1708* [1756](https://github.com/grafana/loki/pull/1756) **sh0rez**: fix(ksonnet): named parameters for containerPort 1709* [1749](https://github.com/grafana/loki/pull/1749) **slim-bean**: Increasing the threshold for a file lag and reducing the severity to warning 1710* [1748](https://github.com/grafana/loki/pull/1748) **slim-bean**: jsonnet: Breakout promtail mixin. 1711* [1739](https://github.com/grafana/loki/pull/1739) **cyriltovena**: Fixes frontend args in libsonnet. 1712* [1735](https://github.com/grafana/loki/pull/1735) **cyriltovena**: Allow to configure global limits via the jsonnet deployment. 1713* [1705](https://github.com/grafana/loki/pull/1705) **cyriltovena**: Add overrides file for our jsonnet library. 1714* [1699](https://github.com/grafana/loki/pull/1699) **pracucci**: Increased production distributors memory request and limit 1715* [1689](https://github.com/grafana/loki/pull/1689) **shokada**: Add headers for WebSocket 1716* [1665](https://github.com/grafana/loki/pull/1665) **cyriltovena**: Query frontend service should be headless. 1717* [1613](https://github.com/grafana/loki/pull/1613) **cyriltovena**: Fixes config change in the result cache 1718 1719#### Fluent Bit 1720* [1791](https://github.com/grafana/loki/pull/1791) **cyriltovena**: Improve fluentbit logfmt. 1721* [1717](https://github.com/grafana/loki/pull/1717) **adityacs**: Fluent-bit: Fix panic error when AutoKubernetesLabels is true 1722 1723#### Fluentd 1724* [1811](https://github.com/grafana/loki/pull/1811) **JamesJJ**: Error handling: Show data stream at "debug" level, not "warn" 1725* [1728](https://github.com/grafana/loki/pull/1728) **irake99**: docs: fix outdated link to fluentd 1726* [1703](https://github.com/grafana/loki/pull/1703) **Skeen**: fluent-plugin-grafana-loki: Update fluentd base image to current images (edge) 1727* [1656](https://github.com/grafana/loki/pull/1656) **takanabe**: Convert second(Integer class) to nanosecond precision 1728* [1646](https://github.com/grafana/loki/pull/1646) **takanabe**: Fix rubocop violation for fluentd/fluent-plugin-loki 1729* [1603](https://github.com/grafana/loki/pull/1603) **tarokkk**: fluentd-plugin: add URI validation 1730 1731#### Docs 1732* [1781](https://github.com/grafana/loki/pull/1781) **candlerb**: Docs: Recommended schema is now v11 1733* [1771](https://github.com/grafana/loki/pull/1771) **rfratto**: change slack url to slack.grafana.com and use https 1734* [1738](https://github.com/grafana/loki/pull/1738) **jgehrcke**: docs: observability.md: clarify lines vs. entries 1735* [1707](https://github.com/grafana/loki/pull/1707) **dangoodman**: Fix regex in pipeline-example.yml 1736* [1697](https://github.com/grafana/loki/pull/1697) **oke-py**: fix promtail/templates/NOTES.txt to show correctly port-forward command 1737* [1675](https://github.com/grafana/loki/pull/1675) **owen-d**: maintainer links & usernames 1738* [1673](https://github.com/grafana/loki/pull/1673) **cyriltovena**: Add Owen to the maintainer team. 1739* [1671](https://github.com/grafana/loki/pull/1671) **shokada**: Update tanka.md so that promtail.yml is the correct format 1740* [1648](https://github.com/grafana/loki/pull/1648) **ShotaKitazawa**: loki-canary: fix indent of DaemonSet manifest written in .md file 1741* [1642](https://github.com/grafana/loki/pull/1642) **slim-bean**: Improve systemd field docs 1742* [1641](https://github.com/grafana/loki/pull/1641) **pastatopf**: Correct syntax of rate example 1743* [1634](https://github.com/grafana/loki/pull/1634) **takanabe**: Unite docs for fluentd plugin 1744* [1619](https://github.com/grafana/loki/pull/1619) **shaikatz**: PeriodConfig documentation fix dynamodb -> aws-dynamo 1745* [1611](https://github.com/grafana/loki/pull/1611) **owen-d**: loki frontend docs additions 1746* [1609](https://github.com/grafana/loki/pull/1609) **Lusitaniae**: Fix wget syntax in documentation 1747* [1608](https://github.com/grafana/loki/pull/1608) **PabloCastellano**: Documentation: Recommend using the latest schema version (v11) 1748* [1601](https://github.com/grafana/loki/pull/1601) **rfratto**: Clarify regex escaping rules 1749* [1598](https://github.com/grafana/loki/pull/1598) **cyriltovena**: Update tanka.md doc. 1750* [1586](https://github.com/grafana/loki/pull/1586) **MrSaints**: Fix typo in changelog for 1.3.0 1751* [1504](https://github.com/grafana/loki/pull/1504) **hsraju**: Updated configuration.md 1752 1753#### Logcli 1754* [1808](https://github.com/grafana/loki/pull/1808) **slim-bean**: logcli: log the full stats and send to stderr instead of stdout 1755* [1682](https://github.com/grafana/loki/pull/1682) **adityacs**: BugFix: Fix logcli --quiet parameter parsing issue 1756* [1644](https://github.com/grafana/loki/pull/1644) **cyriltovena**: This improves the log output for statistics in the logcli. 1757* [1638](https://github.com/grafana/loki/pull/1638) **owen-d**: adds query stats and org id options in logcli 1758* [1573](https://github.com/grafana/loki/pull/1573) **cyriltovena**: Improve logql query statistics collection. 1759 1760#### Loki Canary 1761* [1653](https://github.com/grafana/loki/pull/1653) **slim-bean**: Canary needs its logo 1762* [1581](https://github.com/grafana/loki/pull/1581) **slim-bean**: Add sleep to canary reconnect on error 1763 1764#### Build 1765* [1780](https://github.com/grafana/loki/pull/1780) **slim-bean**: build: Update the CD deploy task name 1766* [1762](https://github.com/grafana/loki/pull/1762) **dgzlopes**: Bump testify to 1.5.1 1767* [1742](https://github.com/grafana/loki/pull/1742) **slim-bean**: build: fix deploy on tagged build 1768* [1741](https://github.com/grafana/loki/pull/1741) **slim-bean**: add darwin and freebsd binaries to release output 1769* [1740](https://github.com/grafana/loki/pull/1740) **rfratto**: Fix 32-bit Promtail ARM docker builds from Drone 1770* [1710](https://github.com/grafana/loki/pull/1710) **adityacs**: Add goimport local-prefixes configuration to .golangci.yml 1771* [1647](https://github.com/grafana/loki/pull/1647) **mattmendick**: Attempting to add `informational` only feedback for codecov 1772* [1640](https://github.com/grafana/loki/pull/1640) **rfratto**: ci: print error messages when an API request fails 1773* [1639](https://github.com/grafana/loki/pull/1639) **rfratto**: ci: prune docker tags prefixed with "master-" older than 90 days 1774* [1637](https://github.com/grafana/loki/pull/1637) **rfratto**: ci: pin plugins/manifest image tag 1775* [1633](https://github.com/grafana/loki/pull/1633) **rfratto**: ci: make manifest publishing run in serial 1776* [1629](https://github.com/grafana/loki/pull/1629) **slim-bean**: Ignore markdown files in codecoverage 1777* [1628](https://github.com/grafana/loki/pull/1628) **rfratto**: Exempt proposals from stale bot 1778* [1614](https://github.com/grafana/loki/pull/1614) **mattmendick**: Codecov: Update config to add informational flag 1779* [1600](https://github.com/grafana/loki/pull/1600) **mattmendick**: Codecov circleci test [WIP] 1780 1781#### Tooling 1782* [1577](https://github.com/grafana/loki/pull/1577) **pstibrany**: Move chunks-inspect tool to Loki repo 1783 1784## 1.3.0 (2020-01-16) 1785 1786### What's New?? ### 1787 1788With 1.3.0 we are excited to announce several improvements focusing on performance! 1789 1790First and most significant is the Query Frontend: 1791 1792* [1442](https://github.com/grafana/loki/pull/1442) **cyriltovena**: Loki Query Frontend 1793 1794The query frontend allows for sharding queries by time and dispatching them in parallel to multiple queriers, giving true horizontal scaling ability for queries. Take a look at the [jsonnet changes](https://github.com/grafana/loki/pull/1442/files?file-filters%5B%5D=.libsonnet) to see how we are deploying this in our production setup. Keep an eye out for a blog post with more information on how the frontend works and more information on this exciting new feature. 1795 1796In our quest to improve query performance, we discovered that gzip, while good for compression ratio, is not the best for speed. So we introduced the ability to select from several different compression algorithms: 1797 1798* [1411](https://github.com/grafana/loki/pull/1411) **cyriltovena**: Adds configurable compression algorithms for chunks 1799 1800We are currently testing out LZ4 and snappy, LZ4 seemed like a good fit however we found that it didn't always compress the same data to the same output which was causing some troubles for another important improvement: 1801 1802* [1438](https://github.com/grafana/loki/pull/1438) **pstibrany**: pkg/ingester: added sync period flags 1803 1804Extending on the work done by @bboreham on Cortex, @pstibrany added a few new flags and code to synchronize chunks between ingesters, which reduces the number of chunks persisted to object stores and therefore also reduces the number of chunks loaded on queries and the amount of de-duplication work which needs to be done. 1805 1806As mentioned above, LZ4 was in some cases compressing the same data with a different result which was interfering with this change, we are still investigating the cause of this issue (It may be in how we implemented something, or may be in the compression code itself). For now we have switched to snappy which has seen a reduction in data written to the object store from almost 3x the source data (with a replication factor of 3) to about 1.5x, saving a lot of duplicated log storage! 1807 1808Another valuable change related to chunks: 1809 1810* [1406](https://github.com/grafana/loki/pull/1406) **slim-bean**: allow configuring a target chunk size in compressed bytes 1811 1812With this change you can set a `chunk_target_size` and Loki will attempt to fill a chunk to approx that size before flushing (previously a chunk size was a hard coded 10 blocks where the default block size is 262144 bytes). Larger chunks are beneficial for a few reasons, mainly on reducing API calls to your object store when performing queries, but also in reducing overhead in a few places, especially when processing very high volume log streams. 1813 1814Another big improvement is the introduction of accurate rate limiting when running microservices: 1815 1816* [1486](https://github.com/grafana/loki/pull/1486) **pracucci**: Add ingestion rate global limit support 1817 1818Previously the rate limit was applied at each distributor, however with traffic split over many distributors the limit would need to be adjusted accordingly. This meant that scaling up distributors required changing the limit. Now this information is communicated between distributors such that the limit should be applied accurately regardless of the number of distributors. 1819 1820And last but not least on the notable changes list is a new feature for Promtail: 1821 1822* [1275](https://github.com/grafana/loki/pull/1275) **bastjan**: pkg/promtail: IETF Syslog (RFC5424) Support 1823 1824With this change Promtail can receive syslogs via TCP! Thanks to @bastjan for all the hard work on this submission! 1825 1826### Important things to note: 1827 1828* [1519](https://github.com/grafana/loki/pull/1519) Changes a core behavior in Loki regarding logs with duplicate content AND duplicate timestamps, previously Loki would store logs with duplicate timestamps and content, moving forward logs with duplicate content AND timestamps will be silently ignored. Mainly this change is to prevent duplicates that appear when a batch is retried (the first entry in the list would be inserted again, now it will be ignored). Logs with the same timestamp and different content will still be accepted. 1829* [1486](https://github.com/grafana/loki/pull/1486) Deprecated `-distributor.limiter-reload-period` flag / distributor's `limiter_reload_period` config option. 1830 1831### All Changes 1832 1833Once again we can't thank our community and contributors enough for the significant work that everyone is adding to Loki, the entire list of changes is long!! 1834 1835#### Loki 1836* [1526](https://github.com/grafana/loki/pull/1526) **codesome**: Support <selector> <range> <filters> for aggregation 1837* [1522](https://github.com/grafana/loki/pull/1522) **cyriltovena**: Adds support for the old query string regexp in the frontend. 1838* [1519](https://github.com/grafana/loki/pull/1519) **rfratto**: pkg/chunkenc: ignore duplicate lines pushed to a stream 1839* [1511](https://github.com/grafana/loki/pull/1511) **sandlis**: querier: fix panic in tailer when max tail duration exceeds 1840* [1499](https://github.com/grafana/loki/pull/1499) **slim-bean**: Fix a panic in chunk prefetch 1841* [1495](https://github.com/grafana/loki/pull/1495) **slim-bean**: Prefetch chunks while processing 1842* [1496](https://github.com/grafana/loki/pull/1496) **cyriltovena**: Add duplicates info and remove timing informations. 1843* [1490](https://github.com/grafana/loki/pull/1490) **owen-d**: Fix/deadlock frontend queue 1844* [1489](https://github.com/grafana/loki/pull/1489) **owen-d**: unifies reverse iterators 1845* [1488](https://github.com/grafana/loki/pull/1488) **cyriltovena**: Fixes response json encoding and add regression tests. 1846* [1486](https://github.com/grafana/loki/pull/1486) **pracucci**: Add ingestion rate global limit support* [1493](https://github.com/grafana/loki/pull/1493) **pracucci**: Added max streams per user global limit 1847* [1480](https://github.com/grafana/loki/pull/1480) **cyriltovena**: Close iterator properly and check nil before releasing buffers. 1848* [1473](https://github.com/grafana/loki/pull/1473) **rfratto**: pkg/querier: don't query all ingesters 1849* [1470](https://github.com/grafana/loki/pull/1470) **cyriltovena**: Validates limit parameter. 1850* [1448](https://github.com/grafana/loki/pull/1448) **cyriltovena**: Improving storage benchmark 1851* [1445](https://github.com/grafana/loki/pull/1445) **cyriltovena**: Add decompression tracing instrumentation. 1852* [1442](https://github.com/grafana/loki/pull/1442) **cyriltovena**: Loki Query Frontend 1853* [1438](https://github.com/grafana/loki/pull/1438) **pstibrany**: pkg/ingester: added sync period flags 1854* [1433](https://github.com/grafana/loki/pull/1433) **zendern**: Using strict parsing for yaml configs 1855* [1425](https://github.com/grafana/loki/pull/1425) **pstibrany**: pkg/ingester: Added possibility to disable transfers. 1856* [1423](https://github.com/grafana/loki/pull/1423) **pstibrany**: pkg/chunkenc: Fix BenchmarkRead to focus on reading chunks, not converting bytes to string 1857* [1421](https://github.com/grafana/loki/pull/1421) **pstibrany**: pkg/chunkenc: change default LZ4 buffer size to 64k. 1858* [1420](https://github.com/grafana/loki/pull/1420) **cyriltovena**: Sets the chunk encoding correctly when creating chunk from bytes. 1859* [1419](https://github.com/grafana/loki/pull/1419) **owen-d**: Enables Series API in loki 1860* [1413](https://github.com/grafana/loki/pull/1413) **pstibrany**: RangeQuery benchmark optimizations 1861* [1411](https://github.com/grafana/loki/pull/1411) **cyriltovena**: Adds configurable compression algorithms for chunks 1862* [1409](https://github.com/grafana/loki/pull/1409) **slim-bean**: change the chunk size histogram to allow for bigger buckets 1863* [1408](https://github.com/grafana/loki/pull/1408) **slim-bean**: forgot to register the new metric for counting blocks per chunk 1864* [1406](https://github.com/grafana/loki/pull/1406) **slim-bean**: allow configuring a target chunk size in compressed bytes 1865* [1405](https://github.com/grafana/loki/pull/1405) **pstibrany**: Convert string to bytes once only when doing string filtering. 1866* [1396](https://github.com/grafana/loki/pull/1396) **pstibrany**: pkg/cfg: print help only when requested, and print it on stdout 1867* [1383](https://github.com/grafana/loki/pull/1383) **beornf**: Read websocket close in tail handler 1868* [1071](https://github.com/grafana/loki/pull/1071) **rfratto**: pkg/ingester: limit total number of errors a stream can return on push 1869* [1545](https://github.com/grafana/loki/pull/1545) **joe-elliott**: Critical n => m conversions 1870* [1541](https://github.com/grafana/loki/pull/1541) **owen-d**: legacy endpoint 400s metric queries 1871 1872#### Promtail 1873* [1515](https://github.com/grafana/loki/pull/1515) **slim-bean**: Promtail: Improve position and size metrics 1874* [1485](https://github.com/grafana/loki/pull/1485) **p37ruh4**: Fileglob parsing fixes 1875* [1472](https://github.com/grafana/loki/pull/1472) **owen-d**: positions.ignore-corruptions 1876* [1453](https://github.com/grafana/loki/pull/1453) **chancez**: pkg/promtail: Initialize counters to 0 when creating client 1877* [1436](https://github.com/grafana/loki/pull/1436) **rfratto**: promtail: add support for passing through journal entries as JSON 1878* [1426](https://github.com/grafana/loki/pull/1426) **wphan**: Support microsecond timestamp format 1879* [1416](https://github.com/grafana/loki/pull/1416) **pstibrany**: pkg/promtail/client: missing URL in client returns error 1880* [1275](https://github.com/grafana/loki/pull/1275) **bastjan**: pkg/promtail: IETF Syslog (RFC5424) Support 1881 1882#### Fluent Bit 1883* [1455](https://github.com/grafana/loki/pull/1455) **JensErat**: fluent-bit-plugin: re-enable failing JSON marshaller tests; pass error instead of logging and ignoring 1884* [1294](https://github.com/grafana/loki/pull/1294) **JensErat**: fluent-bit: multi-instance support 1885* [1514](https://github.com/grafana/loki/pull/1514) **shane-axiom**: fluent-plugin-grafana-loki: Add `fluentd_thread` label when `flush_thread_count` > 1 1886 1887#### Fluentd 1888* [1500](https://github.com/grafana/loki/pull/1500) **cyriltovena**: Bump fluentd plugin to 1.2.6. 1889* [1475](https://github.com/grafana/loki/pull/1475) **Horkyze**: fluentd-plugin: call gsub for strings only 1890 1891#### Docker Driver 1892* [1414](https://github.com/grafana/loki/pull/1414) **cyriltovena**: Adds tenant-id for docker driver. 1893 1894#### Logcli 1895* [1492](https://github.com/grafana/loki/pull/1492) **sandlis**: logcli: replaced GRAFANA_* with LOKI_* in logcli env vars, set default server url for logcli to localhost 1896 1897#### Helm 1898* [1534](https://github.com/grafana/loki/pull/1534) **olivierboudet**: helm : fix fluent-bit parser configuration syntax 1899* [1506](https://github.com/grafana/loki/pull/1506) **terjesannum**: helm: add podsecuritypolicy for fluent-bit 1900* [1431](https://github.com/grafana/loki/pull/1431) **eugene100**: Helm: fix issue with config.clients 1901* [1430](https://github.com/grafana/loki/pull/1430) **olivierboudet**: helm : allow to define custom parsers to use with fluentbit.io/parser annotation 1902* [1418](https://github.com/grafana/loki/pull/1418) **evalsocket**: Helm chart url added in helm.md 1903* [1336](https://github.com/grafana/loki/pull/1336) **terjesannum**: helm: support adding init containers to the loki pod 1904* [1530](https://github.com/grafana/loki/pull/1530) **WeiBanjo**: Allow extra command line args for external labels like hostname 1905 1906#### Jsonnet 1907* [1518](https://github.com/grafana/loki/pull/1518) **benjaminhuo**: Fix error 'Field does not exist: jaeger_mixin' in tk show 1908* [1501](https://github.com/grafana/loki/pull/1501) **anarcher**: jsonnet: fix common/defaultPorts parameters 1909* [1497](https://github.com/grafana/loki/pull/1497) **cyriltovena**: Update Loki mixin to include frontend QPS and latency. 1910* [1478](https://github.com/grafana/loki/pull/1478) **cyriltovena**: Fixes the typo in the result cache config of the Loki ksonnet lib. 1911* [1543](https://github.com/grafana/loki/pull/1543) **sh0rez**: fix(ksonnet): use apps/v1 1912 1913#### Docs 1914* [1531](https://github.com/grafana/loki/pull/1531) **fitzoh**: Documentation: Add note on using Loki with Amazon ECS 1915* [1521](https://github.com/grafana/loki/pull/1521) **rfratto**: docs: Document timestamp ordering rules 1916* [1516](https://github.com/grafana/loki/pull/1516) **rfratto**: Link to release docs in README.md, not master docs 1917* [1508](https://github.com/grafana/loki/pull/1508) **cyriltovena**: Fixes bad json in Loki API documentation. 1918* [1505](https://github.com/grafana/loki/pull/1505) **sandlis**: doc: fix sample yaml in docs for installing promtail to k8s 1919* [1481](https://github.com/grafana/loki/pull/1481) **terjesannum**: docs: fix broken promtail link 1920* [1474](https://github.com/grafana/loki/pull/1474) **Eraac**: <doc>: information about max_look_back_period 1921* [1471](https://github.com/grafana/loki/pull/1471) **cyriltovena**: Update README.md 1922* [1466](https://github.com/grafana/loki/pull/1466) **Eraac**: <documentation>: Update IAM requirement 1923* [1441](https://github.com/grafana/loki/pull/1441) **vtereso**: <Docs>: README spelling fix 1924* [1437](https://github.com/grafana/loki/pull/1437) **daixiang0**: fix all misspell 1925* [1432](https://github.com/grafana/loki/pull/1432) **joe-elliott**: Removed unsupported encodings from docs 1926* [1399](https://github.com/grafana/loki/pull/1399) **vishesh92**: Docs: Add configuration docs for redis 1927* [1394](https://github.com/grafana/loki/pull/1394) **chancez**: Documentation: Fix example AWS storage configuration 1928* [1227](https://github.com/grafana/loki/pull/1227) **daixiang0**: Add docker install doc 1929* [1560](https://github.com/grafana/loki/pull/1560) **robshep**: Promtail Docs: Update output.md 1930* [1546](https://github.com/grafana/loki/pull/1546) **mattmendick**: Removing third-party link 1931* [1539](https://github.com/grafana/loki/pull/1539) **j18e**: docs: fix syntax error in pipeline example 1932 1933#### Build 1934* [1494](https://github.com/grafana/loki/pull/1494) **pracucci**: Fixed TOUCH_PROTOS in all DroneCI pipelines 1935* [1479](https://github.com/grafana/loki/pull/1479) **owen-d**: TOUCH_PROTOS build arg for dockerfile 1936* [1476](https://github.com/grafana/loki/pull/1476) **owen-d**: initiates docker daemon for circle windows builds 1937* [1469](https://github.com/grafana/loki/pull/1469) **rfratto**: Makefile: re-enable journal scraping on ARM 1938 1939#### New Members! 1940* [1415](https://github.com/grafana/loki/pull/1415) **cyriltovena**: Add Joe as member of the team. 1941 1942# 1.2.0 (2019-12-09) 1943 1944One week has passed since the last Loki release, and it's time for a new one! 1945 1946## Notable Changes 1947 1948We have continued our work making our API Prometheus-compatible. The key 1949changes centered around API compatibility are: 1950 1951* [1370](https://github.com/grafana/loki/pull/1370) **slim-bean**: Change `/loki/api/v1/label` to `loki/api/v1/labels` 1952* [1381](https://github.com/grafana/loki/pull/1381) **owen-d**: application/x-www-form-urlencoded support 1953 1954Meanwhile, @pstibrany has done great work ensuring that Loki handles hash 1955collisions properly: 1956 1957* [1247](https://github.com/grafana/loki/pull/1247) **pstibrany**: pkg/ingester: handle labels mapping to the same fast fingerprint. 1958 1959## Other Changes 1960 1961:heart: All PR's are important to us, thanks everyone for continuing to help support and improve Loki! :heart: 1962 1963### Features 1964 1965* [1372](https://github.com/grafana/loki/pull/1372) **cyriltovena**: Let Loki start when using the debug image. 1966* [1300](https://github.com/grafana/loki/pull/1300) **pstibrany**: pkg/ingester: check that ingester is in LEAVING state when transferring chunks and claiming tokens. Required when using memberlist client. 1967 1968### Bug Fixes/Improvements 1969 1970* [1376](https://github.com/grafana/loki/pull/1376) **jstaffans**: Fluentd: guard against nil values when sanitizing labels 1971* [1371](https://github.com/grafana/loki/pull/1371) **cyriltovena**: Logql benchmark and performance improvement. 1972* [1363](https://github.com/grafana/loki/pull/1363) **cyriltovena**: Fixes fluentd new push path API. 1973* [1353](https://github.com/grafana/loki/pull/1353) **pstibrany**: docs: Fix grpc_listen_host and http_listen_host. 1974* [1350](https://github.com/grafana/loki/pull/1350) **Eraac**: documentation: iam requirement for autoscaling 1975 1976# 1.1.0 (2019-12-04) 1977 1978It's been a busy 2 weeks since the 1.0.0 release and quite a few important PR's have been merged to Loki. 1979 1980The most significant: 1981 1982* [1322](https://github.com/grafana/loki/pull/1322) **rfratto**: Fix v1 label API to be Prometheus-compatible 1983 1984Some might call this a **breaking change**, we are instead calling it a bug fix as our goal was to be prometheus compatible and we were not :smiley: 1985 1986**But please be aware if you are using the `/loki/api/v1/label` or `/loki/api/v1/label/<name>/values` the JSON result will be different in 1.1.0** 1987 1988Old result: 1989```json 1990{ 1991 "values": [ 1992 "label1", 1993 "label2", 1994 "labeln" 1995 ] 1996} 1997``` 1998New result: 1999 2000```json 2001{ 2002 "status": "success", 2003 "data": [ 2004 "label1", 2005 "label2", 2006 "labeln" 2007 ] 2008} 2009``` 2010 2011**ALSO IMPORTANT** 2012 2013* [1160](https://github.com/grafana/loki/pull/1160) **daixiang0**: replace gzip with zip 2014 2015Binaries will now be zipped instead of gzipped as many people voiced their opinion that zip is likely to be installed on more systems by default. 2016 2017**If you had existing automation to download and install binaries this will have to be updated to use zip instead of gzip** 2018 2019## Notable Fixes and Improvements 2020 2021* Broken version info in startup log message: 2022 2023 [1095](https://github.com/grafana/loki/pull/1095) **pstibrany**: Makefile changes to allow easy builds with or without vendoring. Also fixes version bug for both cases. 2024 2025* The hashing algorithm used to calculate the hash for a stream was creating hash collisions in some instances. 2026**Please Note** this is just one part of the fix and is only in Promtail, the second part for Loki can be tracked [in PR1247](https://github.com/grafana/loki/pull/1247) which didn't quite make the cut for 1.1.0 and will be in 1.2.0: 2027 2028 [1254](https://github.com/grafana/loki/pull/1254) **pstibrany**: pkg/promtail/client: Handle fingerprint hash collisions 2029 2030* Thank you @putrasattvika for finding and fixing an important bug where logs were some logs were missed in a query shortly after a flush! 2031 2032 [1299](https://github.com/grafana/loki/pull/1299) **putrasattvika**: storage: fix missing logs with batched chunk iterator 2033 2034* Thank you @danieldabate for helping to again improve our API to be more Prometheus compatible: 2035 2036 [1355](https://github.com/grafana/loki/pull/1355) **danieldabate**: HTTP API: Support duration and float formats for step parameter 2037 2038* LogQL will support duration formats that are not typically handled by Go like [1d] or [1w] 2039 2040 [1357](https://github.com/grafana/loki/pull/1357) **cyriltovena**: Supports same duration format in LogQL as Prometheus 2041 2042 2043## Everything Else 2044 2045:heart: All PR's are important to us, thanks everyone for continuing to help support and improve Loki! :heart: 2046 2047* [1349](https://github.com/grafana/loki/pull/1349) **Eraac**: documentation: using parsable value in example 2048* [1343](https://github.com/grafana/loki/pull/1343) **dgzlopes**: doc(configuration): Fix duration format. 2049* [1342](https://github.com/grafana/loki/pull/1342) **whothey**: Makefile: add debug symbols to loki and promtail debug builds 2050* [1341](https://github.com/grafana/loki/pull/1341) **adamjohnson01**: Update loki helm chart to support service account annotations 2051* [1340](https://github.com/grafana/loki/pull/1340) **adamjohnson01**: Pull in cortex changes to support IAM roles for EKS 2052* [1339](https://github.com/grafana/loki/pull/1339) **cyriltovena**: Update gem version. 2053* [1333](https://github.com/grafana/loki/pull/1333) **daixiang0**: fix broken link 2054* [1328](https://github.com/grafana/loki/pull/1328) **cyriltovena**: Fixes linter warning from the yacc file. 2055* [1326](https://github.com/grafana/loki/pull/1326) **dawidmalina**: Wrong api endpoint in fluent-plugin-grafana-loki 2056* [1320](https://github.com/grafana/loki/pull/1320) **roidelapluie**: Metrics: use Namespace everywhere when declaring metrics 2057* [1318](https://github.com/grafana/loki/pull/1318) **roidelapluie**: Use tenant as label name for discarded_samples metrics 2058* [1317](https://github.com/grafana/loki/pull/1317) **roidelapluie**: Expose discarded bytes metric 2059* [1316](https://github.com/grafana/loki/pull/1316) **slim-bean**: Removing old file needed for dep (no longer needed) 2060* [1312](https://github.com/grafana/loki/pull/1312) **ekeih**: Docs: Add missing ) in LogQL example 2061* [1311](https://github.com/grafana/loki/pull/1311) **pstibrany**: Include positions filename in the error when YAML unmarshal fails. 2062* [1310](https://github.com/grafana/loki/pull/1310) **JensErat**: fluent-bit: sorted JSON and properly convert []byte to string 2063* [1304](https://github.com/grafana/loki/pull/1304) **pstibrany**: promtail: write positions to new file first, move to target location afterwards 2064* [1303](https://github.com/grafana/loki/pull/1303) **zhangjianweibj**: https://github.com/grafana/loki/issues/1302 2065* [1298](https://github.com/grafana/loki/pull/1298) **rfratto**: pkg/promtail: remove journal target forced path 2066* [1279](https://github.com/grafana/loki/pull/1279) **rfratto**: Fix loki_discarded_samples_total metric 2067* [1278](https://github.com/grafana/loki/pull/1278) **rfratto**: docs: update limits_config to new structure from #948 2068* [1276](https://github.com/grafana/loki/pull/1276) **roidelapluie**: Update fluentbit README.md based on my experience 2069* [1274](https://github.com/grafana/loki/pull/1274) **sh0rez**: chore(ci): drone-cli 2070* [1273](https://github.com/grafana/loki/pull/1273) **JensErat**: fluent-bit: tenant ID configuration 2071* [1266](https://github.com/grafana/loki/pull/1266) **polar3130**: add description about tenant stage 2072* [1262](https://github.com/grafana/loki/pull/1262) **Eraac**: documentation: iam requirement for autoscaling 2073* [1261](https://github.com/grafana/loki/pull/1261) **rfratto**: Document systemd journal scraping 2074* [1249](https://github.com/grafana/loki/pull/1249) **cyriltovena**: Move to jsoniter instead of default json package 2075* [1223](https://github.com/grafana/loki/pull/1223) **jgehrcke**: authentication.md: replace "user" with "tenant" 2076* [1204](https://github.com/grafana/loki/pull/1204) **allanhung**: fluent-bit-plugin: Auto add Kubernetes labels to Loki labels 2077 2078 2079 2080# 1.0.0 (2019-11-19) 2081 2082:tada: Nearly a year since Loki was announced at KubeCon in Seattle 2018 we are very excited to announce the 1.0.0 release of Loki! :tada: 2083 2084A lot has happened since the announcement, the project just recently passed 1000 commits by 138 contributors over 700+ PR's accumulating over 7700 GitHub stars! 2085 2086Internally at Grafana Labs we have been using Loki to monitor all of our infrastructure and ingest around 1.5TB/10 billion log lines a day. Since the v0.2.0 release we have found Loki to be reliable and stable in our environments. 2087 2088We are comfortable with the state of the project in our production environments and think it's time to promote Loki to a non-beta release to communicate to everyone that they should feel comfortable using Loki in their production environments too. 2089 2090## API Stability 2091 2092With the 1.0.0 release our intent is to try to follow Semver rules regarding stability with some aspects of Loki, focusing mainly on the operating experience of Loki as an application. That is to say we are not planning any major changes to the HTTP API, and anything breaking would likely be accompanied by a major release with backwards compatibility support. 2093 2094We are currently NOT planning on maintaining Go API stability with this release, if you are importing Loki as a library you should be prepared for any kind of change, including breaking, even in minor or bugfix releases. 2095 2096Loki is still a young and active project and there might be some breaking config changes in non-major releases, rest assured this will be clearly communicated and backwards or overlapping compatibility will be provided if possible. 2097 2098## Changes 2099 2100There were not as many changes in this release as the last, mainly we wanted to make sure Loki was mostly stable before 1.0.0. The most notable change is the inclusion of the V11 schema in PR's [1201](https://github.com/grafana/loki/pull/1201) and [1280](https://github.com/grafana/loki/pull/1280). The V11 schema adds some more data to the index to improve label queries over large amounts of time and series. Currently we have not updated the Helm or Ksonnet to use the new schema, this will come soon with more details on how it works. 2101 2102The full list of changes: 2103 2104* [1280](https://github.com/grafana/loki/pull/1280) **owen-d**: Fix duplicate labels (update cortex) 2105* [1260](https://github.com/grafana/loki/pull/1260) **rfratto**: pkg/loki: unmarshal module name from YAML 2106* [1257](https://github.com/grafana/loki/pull/1257) **rfratto**: helm: update default terminationGracePeriodSeconds to 4800 2107* [1251](https://github.com/grafana/loki/pull/1251) **obitech**: docs: Fix promtail releases download link 2108* [1248](https://github.com/grafana/loki/pull/1248) **rfratto**: docs: slightly modify language in community Loki packages section 2109* [1242](https://github.com/grafana/loki/pull/1242) **tarokkk**: fluentd: Suppress unread configuration warning 2110* [1239](https://github.com/grafana/loki/pull/1239) **pracucci**: Move ReservedLabelTenantID out from a dedicated file 2111* [1238](https://github.com/grafana/loki/pull/1238) **oke-py**: helm: loki-stack supports k8s 1.16 2112* [1237](https://github.com/grafana/loki/pull/1237) **joe-elliott**: Rollback google.golang.org/api to 0.8.0 2113* [1235](https://github.com/grafana/loki/pull/1235) **woodsaj**: ci: update triggers to use new deployment_tools location 2114* [1234](https://github.com/grafana/loki/pull/1234) **rfratto**: Standardize schema used in `match` stage 2115* [1233](https://github.com/grafana/loki/pull/1233) **wapmorgan**: Update docker-driver Dockerfile: add tzdb 2116* [1232](https://github.com/grafana/loki/pull/1232) **rfratto**: Fix drone deploy job 2117* [1231](https://github.com/grafana/loki/pull/1231) **joe-elliott**: Removed references to Loki free tier 2118* [1226](https://github.com/grafana/loki/pull/1226) **clickyotomy**: Update dependencies to use weaveworks/common upstream 2119* [1221](https://github.com/grafana/loki/pull/1221) **slim-bean**: use regex label matcher to not alert on any tail route latencies 2120* [1219](https://github.com/grafana/loki/pull/1219) **MightySCollins**: docs: Updated Kubernetes docs links in Helm charts 2121* [1218](https://github.com/grafana/loki/pull/1218) **slim-bean**: update dashboards to include the new /loki/api/v1/* endpoints 2122* [1217](https://github.com/grafana/loki/pull/1217) **slim-bean**: sum the bad words by name and level 2123* [1216](https://github.com/grafana/loki/pull/1216) **joe-elliott**: Remove rules that reference no longer existing metrics 2124* [1215](https://github.com/grafana/loki/pull/1215) **Eraac**: typo url 2125* [1214](https://github.com/grafana/loki/pull/1214) **takanabe**: Correct wrong document paths about querying 2126* [1213](https://github.com/grafana/loki/pull/1213) **slim-bean**: Fix docker latest and master tags 2127* [1212](https://github.com/grafana/loki/pull/1212) **joe-elliott**: Update loki operational 2128* [1206](https://github.com/grafana/loki/pull/1206) **sandlis**: ksonnet: fix replication always set to 3 in ksonnet 2129* [1203](https://github.com/grafana/loki/pull/1203) **joe-elliott**: Chunk iterator performance improvement 2130* [1202](https://github.com/grafana/loki/pull/1202) **beorn7**: Simplify regexp's 2131* [1201](https://github.com/grafana/loki/pull/1201) **cyriltovena**: Update cortex to bring v11 schema 2132* [1189](https://github.com/grafana/loki/pull/1189) **putrasattvika**: fluent-plugin: Add client certificate verification 2133* [1186](https://github.com/grafana/loki/pull/1186) **tarokkk**: fluentd: Refactor label_keys and and add extract_kubernetes_labels configuration 2134 2135# 0.4.0 (2019-10-24) 2136 2137A **huge** thanks to the **36 contributors** who submitted **148 PR's** since 0.3.0! 2138 2139## Notable Changes 2140 2141* With PR [654](https://github.com/grafana/loki/pull/654) @cyriltovena added a really exciting new capability to Loki, a Prometheus compatible API with support for running metric style queries against your logs! [Take a look at how to write metric queries for logs](https://github.com/grafana/loki/blob/master/docs/logql.md#counting-logs) 2142 > PLEASE NOTE: To use metric style queries in the current Grafana release 6.4.x you will need to add Loki as a Prometheus datasource in addition to having it as a Log datasource and you will have to select the correct source for querying logs vs metrics, coming soon Grafana will support both logs and metric queries directly to the Loki datasource! 2143* PR [1022](https://github.com/grafana/loki/pull/1022) (and a few others) @joe-elliott added a new set of HTTP endpoints in conjunction with the work @cyriltovena to create a Prometheus compatible API as well as improve how labels/timestamps are handled 2144 > IMPORTANT: The new `/api/v1/*` endpoints contain breaking changes on the query paths (push path is unchanged) Eventually the `/api/prom/*` endpoints will be removed 2145* PR [847](https://github.com/grafana/loki/pull/847) owes a big thanks to @cosmo0920 for contributing his Fluent Bit go plugin, now loki has Fluent Bit plugin support!! 2146 2147* PR [982](https://github.com/grafana/loki/pull/982) was a couple weeks of painstaking work by @rfratto for a much needed improvement to Loki's docs! [Check them out!](https://github.com/grafana/loki/tree/master/docs) 2148 2149* PR [980](https://github.com/grafana/loki/pull/980) by @sh0rez improved how flags and config file's are loaded to honor a more traditional order of precedence: 2150 1. Defaults 2151 2. Config file 2152 3. User-supplied flag values (command line arguments) 2153 > PLEASE NOTE: This is potentially a breaking change if you were passing command line arguments that also existed in a config file in which case the order they are given priority now has changed! 2154 2155* PR [1062](https://github.com/grafana/loki/pull/1062) and [1089](https://github.com/grafana/loki/pull/1089) have moved Loki from Dep to Go Modules and to Go 1.13 2156 2157 2158## Loki 2159 2160### Features/Improvements/Changes 2161 2162* **Loki** [1171](https://github.com/grafana/loki/pull/1171) **cyriltovena**: Moves request parsing into the loghttp package 2163* **Loki** [1145](https://github.com/grafana/loki/pull/1145) **joe-elliott**: Update `/loki/api/v1/push` to use the v1 json format 2164* **Loki** [1128](https://github.com/grafana/loki/pull/1128) **sandlis**: bigtable-backup: list backups just before starting deletion of wanted backups 2165* **Loki** [1100](https://github.com/grafana/loki/pull/1100) **sandlis**: logging: removed some noise in logs from live-tailing 2166* **Loki/build** [1089](https://github.com/grafana/loki/pull/1089) **joe-elliott**: Go 1.13 2167* **Loki** [1088](https://github.com/grafana/loki/pull/1088) **pstibrany**: Updated cortex to latest master. 2168* **Loki** [1085](https://github.com/grafana/loki/pull/1085) **pracucci**: Do not retry chunks transferring on shutdown in the local dev env 2169* **Loki** [1084](https://github.com/grafana/loki/pull/1084) **pracucci**: Skip ingester tailer filtering if no filter is set 2170* **Loki/build**[1062](https://github.com/grafana/loki/pull/1062) **joe-elliott**: dep => go mod 2171* **Loki** [1049](https://github.com/grafana/loki/pull/1049) **joe-elliott**: Update loki push path 2172* **Loki** [1044](https://github.com/grafana/loki/pull/1044) **joe-elliott**: Fixed broken logql request filtering 2173* **Loki/tools** [1043](https://github.com/grafana/loki/pull/1043) **sandlis**: bigtable-backup: use latest bigtable backup docker image with fix for list backups 2174* **Loki** [1030](https://github.com/grafana/loki/pull/1030) **polar3130**: fix typo in error messages 2175* **Loki/tools** [1028](https://github.com/grafana/loki/pull/1028) **sandlis**: bigtable-backup: verify backups to work on latest list of backups 2176* **Loki** [1022](https://github.com/grafana/loki/pull/1022) **joe-elliott**: Loki HTTP/JSON Model Layer 2177* **Loki** [1016](https://github.com/grafana/loki/pull/1016) **slim-bean**: Revert "Updated stream json objects to be more parse friendly (#1010)" 2178* **Loki** [1010](https://github.com/grafana/loki/pull/1010) **joe-elliott**: Updated stream json objects to be more parse friendly 2179* **Loki** [1009](https://github.com/grafana/loki/pull/1009) **cyriltovena**: Make Loki HTTP API more compatible with Prometheus 2180* **Loki** [1008](https://github.com/grafana/loki/pull/1008) **wardbekker**: Improved Ingester out-of-order error for faster troubleshooting 2181* **Loki** [1001](https://github.com/grafana/loki/pull/1001) **slim-bean**: Update new API paths 2182* **Loki** [998](https://github.com/grafana/loki/pull/998) **sandlis**: Change unit of duration params to hours to align it with duration config at other places in Loki 2183* **Loki** [980](https://github.com/grafana/loki/pull/980) **sh0rez**: feat: configuration source precedence 2184* **Loki** [948](https://github.com/grafana/loki/pull/948) **sandlis**: limits: limits implementation for loki 2185* **Loki** [947](https://github.com/grafana/loki/pull/947) **sandlis**: added a variable for storing periodic table duration as an int to be … 2186* **Loki** [938](https://github.com/grafana/loki/pull/938) **sandlis**: vendoring: update cortex to latest master 2187* **Loki/tools** [930](https://github.com/grafana/loki/pull/930) **sandlis**: fix incrementing of bigtable_backup_job_backups_created metric 2188* **Loki/tools** [920](https://github.com/grafana/loki/pull/920) **sandlis**: bigtable-backup tool fix 2189* **Loki/tools** [895](https://github.com/grafana/loki/pull/895) **sandlis**: bigtable-backup-tool: Improvements 2190* **Loki** [755](https://github.com/grafana/loki/pull/755) **sandlis**: Use grpc client config from cortex for Ingester to get more control 2191* **Loki** [654](https://github.com/grafana/loki/pull/654) **cyriltovena**: LogQL: Vector and Range Vector Aggregation. 2192 2193### Bug Fixes 2194* **Loki** [1114](https://github.com/grafana/loki/pull/1114) **rfratto**: pkg/ingester: prevent shutdowns from processing during joining handoff 2195* **Loki** [1097](https://github.com/grafana/loki/pull/1097) **joe-elliott**: Reverted cloud.google.com/go to 0.44.1 2196* **Loki** [986](https://github.com/grafana/loki/pull/986) **pracucci**: Fix panic in tailer due to race condition between send() and close() 2197* **Loki** [975](https://github.com/grafana/loki/pull/975) **sh0rez**: fix(distributor): parseError BadRequest 2198* **Loki** [944](https://github.com/grafana/loki/pull/944) **rfratto**: pkg/querier: fix concurrent access to querier tail clients 2199 2200## Promtail 2201 2202### Features/Improvements/Changes 2203 2204* **Promtail/pipeline** [1179](https://github.com/grafana/loki/pull/1179) **pracucci**: promtail: fix handling of JMESPath expression returning nil while parsing JSON 2205* **Promtail/pipeline** [1123](https://github.com/grafana/loki/pull/1123) **pracucci**: promtail: added action_on_failure support to timestamp stage 2206* **Promtail/pipeline** [1122](https://github.com/grafana/loki/pull/1122) **pracucci**: promtail: initialize extracted map with initial labels 2207* **Promtail/pipeline** [1112](https://github.com/grafana/loki/pull/1112) **cyriltovena**: Add logql filter to match stages and drop capability 2208* **Promtail/journal** [1109](https://github.com/grafana/loki/pull/1109) **rfratto**: Clarify journal warning 2209* **Promtail** [1083](https://github.com/grafana/loki/pull/1083) **pracucci**: Increased promtail's backoff settings in prod and improved doc 2210* **Promtail** [1026](https://github.com/grafana/loki/pull/1026) **erwinvaneyk**: promtail: fix externalURL and path prefix issues 2211* **Promtail** [976](https://github.com/grafana/loki/pull/976) **slim-bean**: Wrap debug log statements in conditionals to save allocations 2212* **Promtail** [973](https://github.com/grafana/loki/pull/973) **ctrox**: tests: Set default value for BatchWait as ticker does not accept 0 2213* **Promtail** [969](https://github.com/grafana/loki/pull/969) **ctrox**: promtail: Use ticker instead of timer for batch wait 2214* **Promtail** [952](https://github.com/grafana/loki/pull/952) **pracucci**: promtail: add metrics on sent and dropped log entries 2215* **Promtail** [934](https://github.com/grafana/loki/pull/934) **pracucci**: promtail: do not send the last batch - to ingester - if empty 2216* **Promtail** [921](https://github.com/grafana/loki/pull/921) **rfratto**: promtail: add "max_age" field to configure cutoff for journal reading 2217* **Promtail** [883](https://github.com/grafana/loki/pull/883) **adityacs**: Add pipeline unit testing to promtail 2218 2219### Bugfixes 2220 2221* **Promtail** [1194](https://github.com/grafana/loki/pull/1194) **slim-bean**: Improve how we record file size metric to avoid a race in our file lagging alert 2222* **Promtail/journal** [1072](https://github.com/grafana/loki/pull/1072) **rfratto**: build: enable journal in promtail linux release build 2223 2224## Docs 2225 2226* **Docs** [1176](https://github.com/grafana/loki/pull/1176) **rfratto**: docs: add example and documentation about using JMESPath literals 2227* **Docs** [1139](https://github.com/grafana/loki/pull/1139) **joe-elliott**: Moved client docs and add serilog example 2228* **Docs** [1132](https://github.com/grafana/loki/pull/1132) **kailwallin**: FixedTypo.Update README.md 2229* **Docs** [1130](https://github.com/grafana/loki/pull/1130) **pracucci**: docs: fix Promtail / Loki capitalization 2230* **Docs** [1129](https://github.com/grafana/loki/pull/1129) **pracucci**: docs: clarified the relation between retention period and table period 2231* **Docs** [1124](https://github.com/grafana/loki/pull/1124) **geowa4**: Client recommendations documentation tweaks 2232* **Docs** [1106](https://github.com/grafana/loki/pull/1106) **cyriltovena**: Add fluent-bit missing link in the main documentation page. 2233* **Docs** [1099](https://github.com/grafana/loki/pull/1099) **pracucci**: docs: improve table manager documentation 2234* **Docs** [1094](https://github.com/grafana/loki/pull/1094) **rfratto**: docs: update stages README with the docker and cri stages 2235* **Docs** [1091](https://github.com/grafana/loki/pull/1091) **daixiang0**: docs(stage): add docker and cri 2236* **Docs** [1077](https://github.com/grafana/loki/pull/1077) **daixiang0**: doc(fluent-bit): add missing namespace 2237* **Docs** [1073](https://github.com/grafana/loki/pull/1073) **flouthoc**: Re Fix Docs: PR https://github.com/grafana/loki/pull/1053 got erased due to force push. 2238* **Docs** [1069](https://github.com/grafana/loki/pull/1069) **daixiang0**: doc: unify GOPATH 2239* **Docs** [1068](https://github.com/grafana/loki/pull/1068) **daixiang0**: doc: skip jb init when using Tanka 2240* **Docs** [1067](https://github.com/grafana/loki/pull/1067) **rfratto**: Fix broken links to docs in README.md 2241* **Docs** [1064](https://github.com/grafana/loki/pull/1064) **jonaskello**: Fix spelling of HTTP header 2242* **Docs** [1063](https://github.com/grafana/loki/pull/1063) **rfratto**: docs: fix deprecated warning in api.md 2243* **Docs** [1060](https://github.com/grafana/loki/pull/1060) **rfratto**: Add Drone CI badge to README.md 2244* **Docs** [1053](https://github.com/grafana/loki/pull/1053) **flouthoc**: Fix Docs: Change Imagepull policy to IfNotpresent / Add loki-canary b… 2245* **Docs** [1048](https://github.com/grafana/loki/pull/1048) **wassan128**: Loki: Fix README link 2246* **Docs** [1042](https://github.com/grafana/loki/pull/1042) **daixiang0**: doc(ksonnet): include ksonnet-lib 2247* **Docs** [1039](https://github.com/grafana/loki/pull/1039) **sh0rez**: doc(production): replace ksonnet with Tanka 2248* **Docs** [1036](https://github.com/grafana/loki/pull/1036) **sh0rez**: feat: -version flag 2249* **Docs** [1025](https://github.com/grafana/loki/pull/1025) **oddlittlebird**: Update CONTRIBUTING.md 2250* **Docs** [1024](https://github.com/grafana/loki/pull/1024) **oddlittlebird**: Update README.md 2251* **Docs** [1014](https://github.com/grafana/loki/pull/1014) **polar3130**: Fix a link to correct doc and fix a typo 2252* **Docs** [1006](https://github.com/grafana/loki/pull/1006) **slim-bean**: fixing lots of broken links and a few typos 2253* **Docs** [1005](https://github.com/grafana/loki/pull/1005) **SmilingNavern**: Fix links to correct doc 2254* **Docs** [1004](https://github.com/grafana/loki/pull/1004) **rfratto**: docs: fix example with pulling systemd logs 2255* **Docs** [1003](https://github.com/grafana/loki/pull/1003) **oddlittlebird**: Loki: Update README.md 2256* **Docs** [984](https://github.com/grafana/loki/pull/984) **tomgs**: Changing "Usage" link in main readme after docs change 2257* **Docs** [983](https://github.com/grafana/loki/pull/983) **daixiang0**: update positions.yaml location reference 2258* **Docs** [982](https://github.com/grafana/loki/pull/982) **rfratto**: Documentation Rewrite 2259* **Docs** [961](https://github.com/grafana/loki/pull/961) **worr**: doc: Add permissions that IAM roles for Loki need 2260* **Docs** [933](https://github.com/grafana/loki/pull/933) **pracucci**: doc: move promtail doc into dedicated subfolder 2261* **Docs** [924](https://github.com/grafana/loki/pull/924) **pracucci**: doc: promtail known failure modes 2262* **Docs** [910](https://github.com/grafana/loki/pull/910) **slim-bean**: docs(build): Update docs around releasing and fix bug in version updating script 2263* **Docs** [850](https://github.com/grafana/loki/pull/850) **sh0rez**: docs: general documentation rework 2264 2265## Build 2266 2267* **Build** [1157](https://github.com/grafana/loki/pull/1157) **daixiang0**: Update golint 2268* **Build** [1133](https://github.com/grafana/loki/pull/1133) **daixiang0**: bump up golangci to 1.20 2269* **Build** [1121](https://github.com/grafana/loki/pull/1121) **pracucci**: Publish loki-canary binaries on release 2270* **Build** [1054](https://github.com/grafana/loki/pull/1054) **pstibrany**: Fix dep check warnings by running dep ensure 2271* **Build/release** [1018](https://github.com/grafana/loki/pull/1018) **slim-bean**: updating the image version for loki-canary and adding the version increment to the release_prepare script 2272* **Build/CI** [997](https://github.com/grafana/loki/pull/997) **slim-bean**: full circle 2273* **Build/CI** [996](https://github.com/grafana/loki/pull/996) **rfratto**: ci/drone: fix deploy command by escaping double quotes in JSON body 2274* **Build/CI** [995](https://github.com/grafana/loki/pull/995) **slim-bean**: use the loki-build-image for calling circle 2275* **Build/CI** [994](https://github.com/grafana/loki/pull/994) **slim-bean**: Also need bash for the deploy step from drone 2276* **Build/CI** [993](https://github.com/grafana/loki/pull/993) **slim-bean**: Add make to the alpine image used for calling the circle deploy task from drone. 2277* **Build/CI** [992](https://github.com/grafana/loki/pull/992) **sh0rez**: chore(packaging): fix GOPATH being overwritten 2278* **Build/CI** [991](https://github.com/grafana/loki/pull/991) **sh0rez**: chore(packaging): deploy from drone 2279* **Build/CI** [990](https://github.com/grafana/loki/pull/990) **sh0rez**: chore(ci/cd): breaking the circle 2280* **Build** [989](https://github.com/grafana/loki/pull/989) **sh0rez**: chore(packaging): simplify tagging 2281* **Build** [981](https://github.com/grafana/loki/pull/981) **sh0rez**: chore(packaging): loki windows/amd64 2282* **Build** [958](https://github.com/grafana/loki/pull/958) **daixiang0**: sync release pkgs name with release note 2283* **Build/CI** [914](https://github.com/grafana/loki/pull/914) **rfratto**: ci: update apt-get before installing deps for rootless step 2284* **Build** [911](https://github.com/grafana/loki/pull/911) **daixiang0**: optimize image tag script 2285 2286## Deployment 2287 2288* **Ksonnet** [1023](https://github.com/grafana/loki/pull/1023) **slim-bean**: make promtail daemonset name configurable 2289* **Ksonnet** [1021](https://github.com/grafana/loki/pull/1021) **rfratto**: ksonnet: update memcached and memcached-exporter images 2290* **Ksonnet** [1020](https://github.com/grafana/loki/pull/1020) **rfratto**: ksonnet: use consistent hashing in memcached client configs 2291* **Ksonnet** [1017](https://github.com/grafana/loki/pull/1017) **slim-bean**: make promtail configmap name configurable 2292* **Ksonnet** [946](https://github.com/grafana/loki/pull/946) **rfratto**: ksonnet: remove prefix from kvstore.consul settings in loki config 2293* **Ksonnet** [926](https://github.com/grafana/loki/pull/926) **slim-bean**: feat(promtail): Make cluster role configurable 2294<!-- --> 2295* **Helm** [1174](https://github.com/grafana/loki/pull/1174) **rally25rs**: loki-stack: Add release name to prometheus service name. 2296* **Helm** [1152](https://github.com/grafana/loki/pull/1152) **nicr9**: docs(helm): fix broken link to grafana datasource 2297* **Helm** [1134](https://github.com/grafana/loki/pull/1134) **minhdanh**: Helm chart: Allow additional scrape_configs to be added 2298* **Helm** [1111](https://github.com/grafana/loki/pull/1111) **ekarlso**: helm: Add support for passing arbitrary secrets 2299* **Helm** [1110](https://github.com/grafana/loki/pull/1110) **marcosnils**: Bump grafana image in loki helm chart 2300* **Helm** [1104](https://github.com/grafana/loki/pull/1104) **marcosnils**: <Examples>: Deploy prometheus from helm chart 2301* **Helm** [1058](https://github.com/grafana/loki/pull/1058) **polar3130**: Helm: Remove default value of storageClassName in loki/loki helm chart 2302* **Helm** [1056](https://github.com/grafana/loki/pull/1056) **polar3130**: Helm: Fix the reference error of loki/loki helm chart 2303* **Helm** [967](https://github.com/grafana/loki/pull/967) **makocchi-git**: helm chart: Add missing operator to promtail 2304* **Helm** [937](https://github.com/grafana/loki/pull/937) **minhdanh**: helm chart: Add support for additional labels and scrapeTimeout for serviceMonitors 2305* **Helm** [909](https://github.com/grafana/loki/pull/909) **angelbarrera92**: Feature: Add extra containers to loki helm chart 2306* **Helm** [855](https://github.com/grafana/loki/pull/855) **ikeeip**: set helm chart appVersion while release 2307* **Helm** [675](https://github.com/grafana/loki/pull/675) **cyriltovena**: Helm default ingester config 2308 2309## Loki Canary 2310 2311* **Loki-canary** [1137](https://github.com/grafana/loki/pull/1137) **slim-bean**: Add some additional logging to the canary on queries 2312* **Loki-canary** [1131](https://github.com/grafana/loki/pull/1131) **rfratto**: pkg/canary: use default HTTP client when reading from Loki 2313 2314## Logcli 2315 2316* **Logcli** [1168](https://github.com/grafana/loki/pull/1168) **sh0rez**: feat(cli): order flags by categories 2317* **Logcli** [1115](https://github.com/grafana/loki/pull/1115) **pracucci**: logcli: introduced QueryStringBuilder utility to clean up query string encoding 2318* **Logcli** [1103](https://github.com/grafana/loki/pull/1103) **pracucci**: logcli: added --step support to query command 2319* **Logcli** [987](https://github.com/grafana/loki/pull/987) **joe-elliott**: Logcli: Add Support for New Query Path 2320 2321## Tooling 2322 2323* **Dashboards** [1188](https://github.com/grafana/loki/pull/1188) **joe-elliott**: Adding Operational dashboards 2324* **Dashboards** [1143](https://github.com/grafana/loki/pull/1143) **joe-elliott**: Improved compression ratio histogram 2325* **Dashboards** [1126](https://github.com/grafana/loki/pull/1126) **joe-elliott**: Fix Loki Chunks Dashboard 2326* **Tools** [1108](https://github.com/grafana/loki/pull/1108) **joe-elliott**: Updated push path to current prod 2327 2328## Plugins 2329 2330* **DockerDriver** [972](https://github.com/grafana/loki/pull/972) **cyriltovena**: Add stream label to docker driver 2331* **DockerDriver** [971](https://github.com/grafana/loki/pull/971) **cyriltovena**: Allow to pass max-size and max-file to the docker driver 2332* **DockerDriver** [970](https://github.com/grafana/loki/pull/970) **mindfl**: docker-driver compose labels support 2333<!-- --> 2334* **Fluentd** [928](https://github.com/grafana/loki/pull/928) **candlerb**: fluent-plugin-grafana-loki: Escape double-quotes in labels, and suppress labels with value nil 2335<!-- --> 2336* **Fluent Bit** [1155](https://github.com/grafana/loki/pull/1155) **cyriltovena**: rollback fluent-bit push path until we release 0.4 2337* **Fluent Bit** [1096](https://github.com/grafana/loki/pull/1096) **JensErat**: fluent-bit: edge case tests 2338* **Fluent Bit** [847](https://github.com/grafana/loki/pull/847) **cosmo0920**: fluent-bit shared object go plugin 2339 2340## Misc 2341 2342Loki is now using a Bot to help keep issues and PR's pruned based on age/relevancy. Please don't hesitate to comment on an issue or PR that you think was closed by the stale-bot which you think should remain open!! 2343 2344* **Github** [965](https://github.com/grafana/loki/pull/965) **rfratto**: Change label used to keep issues from being marked as stale to keepalive 2345* **Github** [964](https://github.com/grafana/loki/pull/964) **rfratto**: Add probot-stale configuration to close stale issues. 2346 2347 2348 2349 2350 2351 2352 2353 2354 2355 2356 2357# 0.3.0 (2019-08-16) 2358 2359### Features/Enhancements 2360 2361 2362* **Loki** [877](https://github.com/grafana/loki/pull/877) **pracucci**: loki: Improve Tailer loop 2363* **Loki** [870](https://github.com/grafana/loki/pull/870) **sandlis**: bigtable-backup: update docker image for bigtable-backup tool 2364* **Loki** [862](https://github.com/grafana/loki/pull/862) **sandlis**: live-tailing: preload all the historic entries before query context is cancelled 2365* **Loki** [858](https://github.com/grafana/loki/pull/858) **pracucci**: loki: removed unused TestGZIPCompression 2366* **Loki** [854](https://github.com/grafana/loki/pull/854) **adityacs**: Readiness probe for querier 2367* **Loki** [851](https://github.com/grafana/loki/pull/851) **cyriltovena**: Add readiness probe to distributor deployment. 2368* **Loki** [894](https://github.com/grafana/loki/pull/894) **rfratto**: ksonnet: update ingester config to transfer chunks on rollout 2369<!-- --> 2370* **Build** [901](https://github.com/grafana/loki/pull/901) **sh0rez**: chore(packaging): set tag length to 7 2371* **Build** [900](https://github.com/grafana/loki/pull/900) **sh0rez**: chore(ci/cd): fix grafanasaur credentials and CircleCI image build 2372* **Build** [891](https://github.com/grafana/loki/pull/891) **sh0rez**: chore(ci/cd): build containers using drone.io 2373* **Build** [888](https://github.com/grafana/loki/pull/888) **rfratto**: Makefile: disable building promtail with systemd support on non-amd64 platforms 2374* **Build** [887](https://github.com/grafana/loki/pull/887) **slim-bean**: chore(packaging): Dockerfile make avoid containers 2375* **Build** [886](https://github.com/grafana/loki/pull/886) **sh0rez**: chore(packaging): wrong executable format 2376* **Build** [855](https://github.com/grafana/loki/pull/855) **ikeeip**: set helm chart appVersion while release 2377<!-- --> 2378* **Promtail** [856](https://github.com/grafana/loki/pull/856) **martinbaillie**: promtail: Add ServiceMonitor and headless Service 2379* **Promtail** [809](https://github.com/grafana/loki/pull/809) **rfratto**: Makefile: build promtail with CGO_ENABLED if GOHOSTOS=GOOS=linux 2380* **Promtail** [730](https://github.com/grafana/loki/pull/730) **rfratto**: promtail: Add systemd journal support 2381 2382> 809, 730 NOTE: Systemd journal support is currently limited to amd64 images, arm support should come in the future when the transition to building the arm image and binaries is done natively via an arm container 2383<!-- --> 2384* **Docs** [896](https://github.com/grafana/loki/pull/896) **dalance**: docs: fix link format 2385* **Docs** [876](https://github.com/grafana/loki/pull/876) **BouchaaraAdil**: update Docs: update Retention section on Operations doc file 2386* **Docs** [864](https://github.com/grafana/loki/pull/864) **temal-**: docs: Replace old values in operations.md 2387* **Docs** [853](https://github.com/grafana/loki/pull/853) **cyriltovena**: Add governance documentation 2388<!-- --> 2389* **Deployment** [874](https://github.com/grafana/loki/pull/874) **slim-bean**: make our ksonnet a little more modular by parameterizing the chunk and index stores 2390* **Deployment** [857](https://github.com/grafana/loki/pull/857) **slim-bean**: Reorder relabeling rules to prevent pod label from overwriting config define labels 2391 2392> 857 POSSIBLY BREAKING: If you relied on a custom pod label to overwrite one of the labels configured by the other sections of the scrape config: `job`, `namespace`, `instance`, `container_name` and/or `__path__`, this will no longer happen, the custom pod labels are now loaded first and will be overwritten by any of these listed labels. 2393 2394 2395### Fixes 2396 2397* **Loki** [897](https://github.com/grafana/loki/pull/897) **pracucci**: Fix panic in tailer when an ingester is removed from the ring while tailing 2398* **Loki** [880](https://github.com/grafana/loki/pull/880) **cyriltovena**: fix a bug where nil line buffer would be put back 2399* **Loki** [859](https://github.com/grafana/loki/pull/859) **pracucci**: loki: Fixed out of order entries allowed in a chunk on edge case 2400<!-- --> 2401* **Promtail** [893](https://github.com/grafana/loki/pull/893) **rfratto**: pkg/promtail/positions: remove executable bit from positions file 2402<!-- --> 2403* **Deployment** [867](https://github.com/grafana/loki/pull/867) **slim-bean**: Update read dashboard to include only query and label query routes 2404* **Deployment** [865](https://github.com/grafana/loki/pull/865) **sandlis**: fix broken jsonnet for querier 2405<!-- --> 2406* **Canary** [889](https://github.com/grafana/loki/pull/889) **slim-bean**: fix(canary): Fix Flaky Tests 2407<!-- --> 2408* **Pipeline** [869](https://github.com/grafana/loki/pull/869) **jojohappy**: Pipeline: Fixed labels process test with same objects 2409<!-- --> 2410* **Logcli** [863](https://github.com/grafana/loki/pull/863) **adityacs**: Fix Nolabels parse metrics 2411 2412 2413# 0.2.0 (2019-08-02) 2414 2415There were over 100 PR's merged since 0.1.0 was released, here's a highlight: 2416 2417### Features / Enhancements 2418 2419* **Loki**: [521](https://github.com/grafana/loki/pull/521) Query label values and names are now fetched from the store. 2420* **Loki**: [541](https://github.com/grafana/loki/pull/541) Improvements in live tailing of logs. 2421* **Loki**: [713](https://github.com/grafana/loki/pull/713) Storage memory improvement. 2422* **Loki**: [764](https://github.com/grafana/loki/pull/764) Tailing can fetch previous logs for context. 2423* **Loki**: [782](https://github.com/grafana/loki/pull/782) Performance improvement: Query storage by iterating through chunks in batches. 2424* **Loki**: [788](https://github.com/grafana/loki/pull/788) Querier timeouts. 2425* **Loki**: [794](https://github.com/grafana/loki/pull/794) Support ingester chunk transfer on shutdown. 2426* **Loki**: [729](https://github.com/grafana/loki/pull/729) Bigtable backup tool support. 2427<!-- --> 2428* **Pipeline**: [738](https://github.com/grafana/loki/pull/738) Added a template stage for manipulating label values. 2429* **Pipeline**: [732](https://github.com/grafana/loki/pull/732) Support for Unix timestamps. 2430* **Pipeline**: [760](https://github.com/grafana/loki/pull/760) Support timestamps without year. 2431<!-- --> 2432* **Helm**: [641](https://github.com/grafana/loki/pull/641) Helm integration testing. 2433* **Helm**: [824](https://github.com/grafana/loki/pull/824) Add service monitor. 2434* **Helm**: [830](https://github.com/grafana/loki/pull/830) Customize namespace. 2435<!-- --> 2436* **Docker-Plugin**: [663](https://github.com/grafana/loki/pull/663) Created a Docker logging driver plugin. 2437<!-- --> 2438* **Fluent-Plugin**: [669](https://github.com/grafana/loki/pull/669) Ability to specify keys to remove. 2439* **Fluent-Plugin**: [709](https://github.com/grafana/loki/pull/709) Multi-worker support. 2440* **Fluent-Plugin**: [792](https://github.com/grafana/loki/pull/792) Add prometheus for metrics and update gems. 2441<!-- --> 2442* **Build**: [668](https://github.com/grafana/loki/pull/668),[762](https://github.com/grafana/loki/pull/762) Build multiple architecture containers. 2443<!-- --> 2444* **Loki-Canary**: [772](https://github.com/grafana/loki/pull/772) Moved into Loki project. 2445 2446### Bugfixes 2447 2448There were many fixes, here are a few of the most important: 2449 2450* **Promtail**: [650](https://github.com/grafana/loki/pull/650) Build on windows. 2451* **Fluent-Plugin**: [667](https://github.com/grafana/loki/pull/667) Rename fluent plugin. 2452* **Docker-Plugin**: [813](https://github.com/grafana/loki/pull/813) Fix panic for newer docker version (18.09.7+). 2453 2454 2455# 0.1.0 (2019-06-03) 2456 2457First (beta) Release! 2458