1## 2.6.1 / 2019-01-15 2 3* [BUGFIX] Azure SD: Fix discovery getting stuck sometimes. #5088 4* [BUGFIX] Marathon SD: Use `Tasks.Ports` when `RequirePorts` is `false`. #5026 5* [BUGFIX] Promtool: Fix "out-of-order sample" errors when testing rules. #5069 6 7## 2.6.0 / 2018-12-17 8 9* [CHANGE] Remove default flags from the container's entrypoint, run Prometheus from `/etc/prometheus` and symlink the storage directory to `/etc/prometheus/data`. #4976 10* [CHANGE] Promtool: Remove the `update` command. #3839 11* [FEATURE] Add JSON log format via the `--log.format` flag. #4876 12* [FEATURE] API: Add /api/v1/labels endpoint to get all label names. #4835 13* [FEATURE] Web: Allow setting the page's title via the `--web.ui-title` flag. #4841 14* [ENHANCEMENT] Add `prometheus_tsdb_lowest_timestamp_seconds`, `prometheus_tsdb_head_min_time_seconds` and `prometheus_tsdb_head_max_time_seconds` metrics. #4888 15* [ENHANCEMENT] Add `rule_group_last_evaluation_timestamp_seconds` metric. #4852 16* [ENHANCEMENT] Add `prometheus_template_text_expansion_failures_total` and `prometheus_template_text_expansions_total` metrics. #4747 17* [ENHANCEMENT] Set consistent User-Agent header in outgoing requests. #4891 18* [ENHANCEMENT] Azure SD: Error out at load time when authentication parameters are missing. #4907 19* [ENHANCEMENT] EC2 SD: Add the machine's private DNS name to the discovery metadata. #4693 20* [ENHANCEMENT] EC2 SD: Add the operating system's platform to the discovery metadata. #4663 21* [ENHANCEMENT] Kubernetes SD: Add the pod's phase to the discovery metadata. #4824 22* [ENHANCEMENT] Kubernetes SD: Log Kubernetes messages. #4931 23* [ENHANCEMENT] Promtool: Collect CPU and trace profiles. #4897 24* [ENHANCEMENT] Promtool: Support writing output as JSON. #4848 25* [ENHANCEMENT] Remote Read: Return available data if remote read fails partially. #4832 26* [ENHANCEMENT] Remote Write: Improve queue performance. #4772 27* [ENHANCEMENT] Remote Write: Add min_shards parameter to set the minimum number of shards. #4924 28* [ENHANCEMENT] TSDB: Improve WAL reading. #4953 29* [ENHANCEMENT] TSDB: Memory improvements. #4953 30* [ENHANCEMENT] Web: Log stack traces on panic. #4221 31* [ENHANCEMENT] Web UI: Add copy to clipboard button for configuration. #4410 32* [ENHANCEMENT] Web UI: Support console queries at specific times. #4764 33* [ENHANCEMENT] Web UI: group targets by job then instance. #4898 #4806 34* [BUGFIX] Deduplicate handler labels for HTTP metrics. #4732 35* [BUGFIX] Fix leaked queriers causing shutdowns to hang. #4922 36* [BUGFIX] Fix configuration loading panics on nil pointer slice elements. #4942 37* [BUGFIX] API: Correctly skip mismatching targets on /api/v1/targets/metadata. #4905 38* [BUGFIX] API: Better rounding for incoming query timestamps. #4941 39* [BUGFIX] Azure SD: Fix panic. #4867 40* [BUGFIX] Console templates: Fix hover when the metric has a null value. #4906 41* [BUGFIX] Discovery: Remove all targets when the scrape configuration gets empty. #4819 42* [BUGFIX] Marathon SD: Fix leaked connections. #4915 43* [BUGFIX] Marathon SD: Use 'hostPort' member of portMapping to construct target endpoints. #4887 44* [BUGFIX] PromQL: Fix a goroutine leak in the lexer/parser. #4858 45* [BUGFIX] Scrape: Pass through content-type for non-compressed output. #4912 46* [BUGFIX] Scrape: Fix deadlock in the scrape's manager. #4894 47* [BUGFIX] Scrape: Scrape targets at fixed intervals even after Prometheus restarts. #4926 48* [BUGFIX] TSDB: Support restored snapshots including the head properly. #4953 49* [BUGFIX] TSDB: Repair WAL when the last record in a segment is torn. #4953 50* [BUGFIX] TSDB: Fix unclosed file readers on Windows systems. #4997 51* [BUGFIX] Web: Avoid proxy to connect to the local gRPC server. #4572 52 53## 2.5.0 / 2018-11-06 54 55* [CHANGE] Group targets by scrape config instead of job name. #4806 #4526 56* [CHANGE] Marathon SD: Various changes to adapt to Marathon 1.5+. #4499 57* [CHANGE] Discovery: Split `prometheus_sd_discovered_targets` metric by scrape and notify (Alertmanager SD) as well as by section in the respective configuration. #4753 58* [FEATURE] Add OpenMetrics support for scraping (EXPERIMENTAL). #4700 59* [FEATURE] Add unit testing for rules. #4350 60* [FEATURE] Make maximum number of samples per query configurable via `--query.max-samples` flag. #4513 61* [FEATURE] Make maximum number of concurrent remote reads configurable via `--storage.remote.read-concurrent-limit` flag. #4656 62* [ENHANCEMENT] Support s390x platform for Linux. #4605 63* [ENHANCEMENT] API: Add `prometheus_api_remote_read_queries` metric tracking currently executed or waiting remote read API requests. #4699 64* [ENHANCEMENT] Remote Read: Add `prometheus_remote_storage_remote_read_queries` metric tracking currently in-flight remote read queries. #4677 65* [ENHANCEMENT] Remote Read: Reduced memory usage. #4655 66* [ENHANCEMENT] Discovery: Add `prometheus_sd_discovered_targets`, `prometheus_sd_received_updates_total`, `prometheus_sd_updates_delayed_total`, and `prometheus_sd_updates_total` metrics for discovery subsystem. #4667 67* [ENHANCEMENT] Discovery: Improve performance of previously slow updates of changes of targets. #4526 68* [ENHANCEMENT] Kubernetes SD: Add extended metrics. #4458 69* [ENHANCEMENT] OpenStack SD: Support discovering instances from all projects. #4682 70* [ENHANCEMENT] OpenStack SD: Discover all interfaces. #4649 71* [ENHANCEMENT] OpenStack SD: Support `tls_config` for the used HTTP client. #4654 72* [ENHANCEMENT] Triton SD: Add ability to filter triton_sd targets by pre-defined groups. #4701 73* [ENHANCEMENT] Web UI: Avoid browser spell-checking in expression field. #4728 74* [ENHANCEMENT] Web UI: Add scrape duration and last evaluation time in targets and rules pages. #4722 75* [ENHANCEMENT] Web UI: Improve rule view by wrapping lines. #4702 76* [ENHANCEMENT] Rules: Error out at load time for invalid templates, rather than at evaluation time. #4537 77* [ENHANCEMENT] TSDB: Add metrics for WAL operations. #4692 78* [BUGFIX] Change max/min over_time to handle NaNs properly. #4386 79* [BUGFIX] Check label name for `count_values` PromQL function. #4585 80* [BUGFIX] Ensure that vectors and matrices do not contain identical label-sets. #4589 81 82## 2.4.3 / 2018-10-04 83 84* [BUGFIX] Fix panic when using custom EC2 API for SD #4672 85* [BUGFIX] Fix panic when Zookeeper SD cannot connect to servers #4669 86* [BUGFIX] Make the skip_head an optional parameter for snapshot API #4674 87 88## 2.4.2 / 2018-09-21 89 90 The last release didn't have bugfix included due to a vendoring error. 91 92 * [BUGFIX] Handle WAL corruptions properly prometheus/tsdb#389 93 * [BUGFIX] Handle WAL migrations correctly on Windows prometheus/tsdb#392 94 95## 2.4.1 / 2018-09-19 96 97* [ENHANCEMENT] New TSDB metrics prometheus/tsdb#375 prometheus/tsdb#363 98* [BUGFIX] Render UI correctly for Windows #4616 99 100## 2.4.0 / 2018-09-11 101 102This release includes multiple bugfixes and features. Further, the WAL implementation has been re-written so the storage is not forward compatible. Prometheus 2.3 storage will work on 2.4 but not vice-versa. 103 104* [CHANGE] Reduce remote write default retries #4279 105* [CHANGE] Remove /heap endpoint #4460 106* [FEATURE] Persist alert 'for' state across restarts #4061 107* [FEATURE] Add API providing per target metric metadata #4183 108* [FEATURE] Add API providing recording and alerting rules #4318 #4501 109* [ENHANCEMENT] Brand new WAL implementation for TSDB. Forwards incompatible with previous WAL. 110* [ENHANCEMENT] Show rule evaluation errors in UI #4457 111* [ENHANCEMENT] Throttle resends of alerts to Alertmanager #4538 112* [ENHANCEMENT] Send EndsAt along with the alert to Alertmanager #4550 113* [ENHANCEMENT] Limit the samples returned by remote read endpoint #4532 114* [ENHANCEMENT] Limit the data read in through remote read #4239 115* [ENHANCEMENT] Coalesce identical SD configurations #3912 116* [ENHANCEMENT] `promtool`: Add new commands for debugging and querying #4247 #4308 #4346 #4454 117* [ENHANCEMENT] Update console examples for node_exporter v0.16.0 #4208 118* [ENHANCEMENT] Optimize PromQL aggregations #4248 119* [ENHANCEMENT] Remote read: Add Offset to hints #4226 120* [ENHANCEMENT] `consul_sd`: Add support for ServiceMeta field #4280 121* [ENHANCEMENT] `ec2_sd`: Maintain order of subnet_id label #4405 122* [ENHANCEMENT] `ec2_sd`: Add support for custom endpoint to support EC2 compliant APIs #4333 123* [ENHANCEMENT] `ec2_sd`: Add instance_owner label #4514 124* [ENHANCEMENT] `azure_sd`: Add support for VMSS discovery and multiple environments #4202 #4569 125* [ENHANCEMENT] `gce_sd`: Add instance_id label #4488 126* [ENHANCEMENT] Forbid rule-abiding robots from indexing #4266 127* [ENHANCEMENT] Log virtual memory limits on startup #4418 128* [BUGFIX] Wait for service discovery to stop before exiting #4508 129* [BUGFIX] Render SD configs properly #4338 130* [BUGFIX] Only add LookbackDelta to vector selectors #4399 131* [BUGFIX] `ec2_sd`: Handle panic-ing nil pointer #4469 132* [BUGFIX] `consul_sd`: Stop leaking connections #4443 133* [BUGFIX] Use templated labels also to identify alerts #4500 134* [BUGFIX] Reduce floating point errors in stddev and related functions #4533 135* [BUGFIX] Log errors while encoding responses #4359 136 137## 2.3.2 / 2018-07-12 138 139* [BUGFIX] Fix various tsdb bugs #4369 140* [BUGFIX] Reorder startup and shutdown to prevent panics. #4321 141* [BUGFIX] Exit with non-zero code on error #4296 142* [BUGFIX] discovery/kubernetes/ingress: fix scheme discovery #4329 143* [BUGFIX] Fix race in zookeeper sd #4355 144* [BUGFIX] Better timeout handling in promql #4291 #4300 145* [BUGFIX] Propagate errors when selecting series from the tsdb #4136 146 147## 2.3.1 / 2018-06-19 148 149* [BUGFIX] Avoid infinite loop on duplicate NaN values. #4275 150* [BUGFIX] Fix nil pointer deference when using various API endpoints #4282 151* [BUGFIX] config: set target group source index during unmarshaling #4245 152* [BUGFIX] discovery/file: fix logging #4178 153* [BUGFIX] kubernetes_sd: fix namespace filtering #4285 154* [BUGFIX] web: restore old path prefix behavior #4273 155* [BUGFIX] web: remove security headers added in 2.3.0 #4259 156 157## 2.3.0 / 2018-06-05 158 159* [CHANGE] `marathon_sd`: use `auth_token` and `auth_token_file` for token-based authentication instead of `bearer_token` and `bearer_token_file` respectively. 160* [CHANGE] Metric names for HTTP server metrics changed 161* [FEATURE] Add query commands to promtool 162* [FEATURE] Add security headers to HTTP server responses 163* [FEATURE] Pass query hints via remote read API 164* [FEATURE] Basic auth passwords can now be configured via file across all configuration 165* [ENHANCEMENT] Optimize PromQL and API serialization for memory usage and allocations 166* [ENHANCEMENT] Limit number of dropped targets in web UI 167* [ENHANCEMENT] Consul and EC2 service discovery allow using server-side filtering for performance improvement 168* [ENHANCEMENT] Add advanced filtering configuration to EC2 service discovery 169* [ENHANCEMENT] `marathon_sd`: adds support for basic and bearer authentication, plus all other common HTTP client options (TLS config, proxy URL, etc.) 170* [ENHANCEMENT] Provide machine type metadata and labels in GCE service discovery 171* [ENHANCEMENT] Add pod controller kind and name to Kubernetes service discovery data 172* [ENHANCEMENT] Move TSDB to flock-based log file that works with Docker containers 173* [BUGFIX] Properly propagate storage errors in PromQL 174* [BUGFIX] Fix path prefix for web pages 175* [BUGFIX] Fix goroutine leak in Consul service discovery 176* [BUGFIX] Fix races in scrape manager 177* [BUGFIX] Fix OOM for very large k in PromQL topk() queries 178* [BUGFIX] Make remote write more resilient to unavailable receivers 179* [BUGFIX] Make remote write shutdown cleanly 180* [BUGFIX] Don't leak files on errors in TSDB's tombstone cleanup 181* [BUGFIX] Unary minus expressions now removes the metric name from results 182* [BUGFIX] Fix bug that lead to wrong amount of samples considered for time range expressions 183 184## 2.2.1 / 2018-03-13 185 186* [BUGFIX] Fix data loss in TSDB on compaction 187* [BUGFIX] Correctly stop timer in remote-write path 188* [BUGFIX] Fix deadlock triggered by loading targets page 189* [BUGFIX] Fix incorrect buffering of samples on range selection queries 190* [BUGFIX] Handle large index files on windows properly 191 192## 2.2.0 / 2018-03-08 193 194* [CHANGE] Rename file SD mtime metric. 195* [CHANGE] Send target update on empty pod IP in Kubernetes SD. 196* [FEATURE] Add API endpoint for flags. 197* [FEATURE] Add API endpoint for dropped targets. 198* [FEATURE] Display annotations on alerts page. 199* [FEATURE] Add option to skip head data when taking snapshots. 200* [ENHANCEMENT] Federation performance improvement. 201* [ENHANCEMENT] Read bearer token file on every scrape. 202* [ENHANCEMENT] Improve typeahead on `/graph` page. 203* [ENHANCEMENT] Change rule file formatting. 204* [ENHANCEMENT] Set consul server default to `localhost:8500`. 205* [ENHANCEMENT] Add dropped Alertmanagers to API info endpoint. 206* [ENHANCEMENT] Add OS type meta label to Azure SD. 207* [ENHANCEMENT] Validate required fields in SD configuration. 208* [BUGFIX] Prevent stack overflow on deep recursion in TSDB. 209* [BUGFIX] Correctly read offsets in index files that are greater than 4GB. 210* [BUGFIX] Fix scraping behavior for empty labels. 211* [BUGFIX] Drop metric name for bool modifier. 212* [BUGFIX] Fix races in discovery. 213* [BUGFIX] Fix Kubernetes endpoints SD for empty subsets. 214* [BUGFIX] Throttle updates from SD providers, which caused increased CPU usage and allocations. 215* [BUGFIX] Fix TSDB block reload issue. 216* [BUGFIX] Fix PromQL printing of empty `without()`. 217* [BUGFIX] Don't reset FiredAt for inactive alerts. 218* [BUGFIX] Fix erroneous file version changes and repair existing data. 219 220## 2.1.0 / 2018-01-19 221 222* [FEATURE] New Service Discovery UI showing labels before and after relabelling. 223* [FEATURE] New Admin APIs added to v1 to delete, snapshot and remove tombstones. 224* [ENHANCEMENT] The graph UI autcomplete now includes your previous queries. 225* [ENHANCEMENT] Federation is now much faster for large numbers of series. 226* [ENHANCEMENT] Added new metrics to measure rule timings. 227* [ENHANCEMENT] Rule evaluation times added to the rules UI. 228* [ENHANCEMENT] Added metrics to measure modified time of file SD files. 229* [ENHANCEMENT] Kubernetes SD now includes POD UID in discovery metadata. 230* [ENHANCEMENT] The Query APIs now return optional stats on query execution times. 231* [ENHANCEMENT] The index now no longer has the 4GiB size limit and is also smaller. 232* [BUGFIX] Remote read `read_recent` option is now false by default. 233* [BUGFIX] Pass the right configuration to each Alertmanager (AM) when using multiple AM configs. 234* [BUGFIX] Fix not-matchers not selecting series with labels unset. 235* [BUGFIX] tsdb: Fix occasional panic in head block. 236* [BUGFIX] tsdb: Close files before deletion to fix retention issues on Windows and NFS. 237* [BUGFIX] tsdb: Cleanup and do not retry failing compactions. 238* [BUGFIX] tsdb: Close WAL while shutting down. 239 240 241## 2.0.0 / 2017-11-08 242 243This release includes a completely rewritten storage, huge performance 244improvements, but also many backwards incompatible changes. For more 245information, read the announcement blog post and migration guide. 246 247https://prometheus.io/blog/2017/11/08/announcing-prometheus-2-0/ 248https://prometheus.io/docs/prometheus/2.0/migration/ 249 250* [CHANGE] Completely rewritten storage layer, with WAL. This is not backwards compatible with 1.x storage, and many flags have changed/disappeared. 251* [CHANGE] New staleness behavior. Series now marked stale after target scrapes no longer return them, and soon after targets disappear from service discovery. 252* [CHANGE] Rules files use YAML syntax now. Conversion tool added to promtool. 253* [CHANGE] Removed `count_scalar`, `drop_common_labels` functions and `keep_common` modifier from PromQL. 254* [CHANGE] Rewritten exposition format parser with much higher performance. The Protobuf exposition format is no longer supported. 255* [CHANGE] Example console templates updated for new storage and metrics names. Examples other than node exporter and Prometheus removed. 256* [CHANGE] Admin and lifecycle APIs now disabled by default, can be re-enabled via flags 257* [CHANGE] Flags switched to using Kingpin, all flags are now --flagname rather than -flagname. 258* [FEATURE/CHANGE] Remote read can be configured to not read data which is available locally. This is enabled by default. 259* [FEATURE] Rules can be grouped now. Rules within a rule group are executed sequentially. 260* [FEATURE] Added experimental GRPC apis 261* [FEATURE] Add timestamp() function to PromQL. 262* [ENHANCEMENT] Remove remote read from the query path if no remote storage is configured. 263* [ENHANCEMENT] Bump Consul HTTP client timeout to not match the Consul SD watch timeout. 264* [ENHANCEMENT] Go-conntrack added to provide HTTP connection metrics. 265* [BUGFIX] Fix connection leak in Consul SD. 266 267## 1.8.2 / 2017-11-04 268 269* [BUGFIX] EC2 service discovery: Do not crash if tags are empty. 270 271## 1.8.1 / 2017-10-19 272 273* [BUGFIX] Correctly handle external labels on remote read endpoint 274 275## 1.8.0 / 2017-10-06 276 277* [CHANGE] Rule links link to the _Console_ tab rather than the _Graph_ tab to 278 not trigger expensive range queries by default. 279* [FEATURE] Ability to act as a remote read endpoint for other Prometheus 280 servers. 281* [FEATURE] K8s SD: Support discovery of ingresses. 282* [FEATURE] Consul SD: Support for node metadata. 283* [FEATURE] Openstack SD: Support discovery of hypervisors. 284* [FEATURE] Expose current Prometheus config via `/status/config`. 285* [FEATURE] Allow to collapse jobs on `/targets` page. 286* [FEATURE] Add `/-/healthy` and `/-/ready` endpoints. 287* [FEATURE] Add color scheme support to console templates. 288* [ENHANCEMENT] Remote storage connections use HTTP keep-alive. 289* [ENHANCEMENT] Improved logging about remote storage. 290* [ENHANCEMENT] Relaxed URL validation. 291* [ENHANCEMENT] Openstack SD: Handle instances without IP. 292* [ENHANCEMENT] Make remote storage queue manager configurable. 293* [ENHANCEMENT] Validate metrics returned from remote read. 294* [ENHANCEMENT] EC2 SD: Set a default region. 295* [ENHANCEMENT] Changed help link to `https://prometheus.io/docs`. 296* [BUGFIX] Fix floating-point precision issue in `deriv` function. 297* [BUGFIX] Fix pprof endpoints when -web.route-prefix or -web.external-url is 298 used. 299* [BUGFIX] Fix handling of `null` target groups in file-based SD. 300* [BUGFIX] Set the sample timestamp in date-related PromQL functions. 301* [BUGFIX] Apply path prefix to redirect from deprecated graph URL. 302* [BUGFIX] Fixed tests on MS Windows. 303* [BUGFIX] Check for invalid UTF-8 in label values after relabeling. 304 305## 1.7.2 / 2017-09-26 306 307* [BUGFIX] Correctly remove all targets from DNS service discovery if the 308 corresponding DNS query succeeds and returns an empty result. 309* [BUGFIX] Correctly parse resolution input in expression browser. 310* [BUGFIX] Consistently use UTC in the date picker of the expression browser. 311* [BUGFIX] Correctly handle multiple ports in Marathon service discovery. 312* [BUGFIX] Fix HTML escaping so that HTML templates compile with Go1.9. 313* [BUGFIX] Prevent number of remote write shards from going negative. 314* [BUGFIX] In the graphs created by the expression browser, render very large 315 and small numbers in a readable way. 316* [BUGFIX] Fix a rarely occurring iterator issue in varbit encoded chunks. 317 318## 1.7.1 / 2017-06-12 319 320* [BUGFIX] Fix double prefix redirect. 321 322## 1.7.0 / 2017-06-06 323 324* [CHANGE] Compress remote storage requests and responses with unframed/raw snappy. 325* [CHANGE] Properly ellide secrets in config. 326* [FEATURE] Add OpenStack service discovery. 327* [FEATURE] Add ability to limit Kubernetes service discovery to certain namespaces. 328* [FEATURE] Add metric for discovered number of Alertmanagers. 329* [ENHANCEMENT] Print system information (uname) on start up. 330* [ENHANCEMENT] Show gaps in graphs on expression browser. 331* [ENHANCEMENT] Promtool linter checks counter naming and more reserved labels. 332* [BUGFIX] Fix broken Mesos discovery. 333* [BUGFIX] Fix redirect when external URL is set. 334* [BUGFIX] Fix mutation of active alert elements by notifier. 335* [BUGFIX] Fix HTTP error handling for remote write. 336* [BUGFIX] Fix builds for Solaris/Illumos. 337* [BUGFIX] Fix overflow checking in global config. 338* [BUGFIX] Fix log level reporting issue. 339* [BUGFIX] Fix ZooKeeper serverset discovery can become out-of-sync. 340 341## 1.6.3 / 2017-05-18 342 343* [BUGFIX] Fix disappearing Alertmanger targets in Alertmanager discovery. 344* [BUGFIX] Fix panic with remote_write on ARMv7. 345* [BUGFIX] Fix stacked graphs to adapt min/max values. 346 347## 1.6.2 / 2017-05-11 348 349* [BUGFIX] Fix potential memory leak in Kubernetes service discovery 350 351## 1.6.1 / 2017-04-19 352 353* [BUGFIX] Don't panic if storage has no FPs even after initial wait 354 355## 1.6.0 / 2017-04-14 356 357* [CHANGE] Replaced the remote write implementations for various backends by a 358 generic write interface with example adapter implementation for various 359 backends. Note that both the previous and the current remote write 360 implementations are **experimental**. 361* [FEATURE] New flag `-storage.local.target-heap-size` to tell Prometheus about 362 the desired heap size. This deprecates the flags 363 `-storage.local.memory-chunks` and `-storage.local.max-chunks-to-persist`, 364 which are kept for backward compatibility. 365* [FEATURE] Add `check-metrics` to `promtool` to lint metric names. 366* [FEATURE] Add Joyent Triton discovery. 367* [FEATURE] `X-Prometheus-Scrape-Timeout-Seconds` header in HTTP scrape 368 requests. 369* [FEATURE] Remote read interface, including example for InfluxDB. **Experimental.** 370* [FEATURE] Enable Consul SD to connect via TLS. 371* [FEATURE] Marathon SD supports multiple ports. 372* [FEATURE] Marathon SD supports bearer token for authentication. 373* [FEATURE] Custom timeout for queries. 374* [FEATURE] Expose `buildQueryUrl` in `graph.js`. 375* [FEATURE] Add `rickshawGraph` property to the graph object in console 376 templates. 377* [FEATURE] New metrics exported by Prometheus itself: 378 * Summary `prometheus_engine_query_duration_seconds` 379 * Counter `prometheus_evaluator_iterations_missed_total` 380 * Counter `prometheus_evaluator_iterations_total` 381 * Gauge `prometheus_local_storage_open_head_chunks` 382 * Gauge `prometheus_local_storage_target_heap_size` 383* [ENHANCEMENT] Reduce shut-down time by interrupting an ongoing checkpoint 384 before starting the final checkpoint. 385* [ENHANCEMENT] Auto-tweak times between checkpoints to limit time spent in 386 checkpointing to 50%. 387* [ENHANCEMENT] Improved crash recovery deals better with certain index 388 corruptions. 389* [ENHANCEMENT] Graphing deals better with constant time series. 390* [ENHANCEMENT] Retry remote writes on recoverable errors. 391* [ENHANCEMENT] Evict unused chunk descriptors during crash recovery to limit 392 memory usage. 393* [ENHANCEMENT] Smoother disk usage during series maintenance. 394* [ENHANCEMENT] Targets on targets page sorted by instance within a job. 395* [ENHANCEMENT] Sort labels in federation. 396* [ENHANCEMENT] Set `GOGC=40` by default, which results in much better memory 397 utilization at the price of slightly higher CPU usage. If `GOGC` is set by 398 the user, it is still honored as usual. 399* [ENHANCEMENT] Close head chunks after being idle for the duration of the 400 configured staleness delta. This helps to persist and evict head chunk of 401 stale series more quickly. 402* [ENHANCEMENT] Stricter checking of relabel config. 403* [ENHANCEMENT] Cache busters for static web content. 404* [ENHANCEMENT] Send Prometheus-specific user-agent header during scrapes. 405* [ENHANCEMENT] Improved performance of series retention cut-off. 406* [ENHANCEMENT] Mitigate impact of non-atomic sample ingestion on 407 `histogram_quantile` by enforcing buckets to be monotonic. 408* [ENHANCEMENT] Released binaries built with Go 1.8.1. 409* [BUGFIX] Send `instance=""` with federation if `instance` not set. 410* [BUGFIX] Update to new `client_golang` to get rid of unwanted quantile 411 metrics in summaries. 412* [BUGFIX] Introduce several additional guards against data corruption. 413* [BUGFIX] Mark storage dirty and increment 414 `prometheus_local_storage_persist_errors_total` on all relevant errors. 415* [BUGFIX] Propagate storage errors as 500 in the HTTP API. 416* [BUGFIX] Fix int64 overflow in timestamps in the HTTP API. 417* [BUGFIX] Fix deadlock in Zookeeper SD. 418* [BUGFIX] Fix fuzzy search problems in the web-UI auto-completion. 419 420## 1.5.3 / 2017-05-11 421 422* [BUGFIX] Fix potential memory leak in Kubernetes service discovery 423 424## 1.5.2 / 2017-02-10 425 426* [BUGFIX] Fix series corruption in a special case of series maintenance where 427 the minimum series-file-shrink-ratio kicks in. 428* [BUGFIX] Fix two panic conditions both related to processing a series 429 scheduled to be quarantined. 430* [ENHANCEMENT] Binaries built with Go1.7.5. 431 432## 1.5.1 / 2017-02-07 433 434* [BUGFIX] Don't lose fully persisted memory series during checkpointing. 435* [BUGFIX] Fix intermittently failing relabeling. 436* [BUGFIX] Make `-storage.local.series-file-shrink-ratio` work. 437* [BUGFIX] Remove race condition from TestLoop. 438 439## 1.5.0 / 2017-01-23 440 441* [CHANGE] Use lexicographic order to sort alerts by name. 442* [FEATURE] Add Joyent Triton discovery. 443* [FEATURE] Add scrape targets and alertmanager targets API. 444* [FEATURE] Add various persistence related metrics. 445* [FEATURE] Add various query engine related metrics. 446* [FEATURE] Add ability to limit scrape samples, and related metrics. 447* [FEATURE] Add labeldrop and labelkeep relabelling actions. 448* [FEATURE] Display current working directory on status-page. 449* [ENHANCEMENT] Strictly use ServiceAccount for in cluster configuration on Kubernetes. 450* [ENHANCEMENT] Various performance and memory-management improvements. 451* [BUGFIX] Fix basic auth for alertmanagers configured via flag. 452* [BUGFIX] Don't panic on decoding corrupt data. 453* [BUGFIX] Ignore dotfiles in data directory. 454* [BUGFIX] Abort on intermediate federation errors. 455 456## 1.4.1 / 2016-11-28 457 458* [BUGFIX] Fix Consul service discovery 459 460## 1.4.0 / 2016-11-25 461 462* [FEATURE] Allow configuring Alertmanagers via service discovery 463* [FEATURE] Display used Alertmanagers on runtime page in the UI 464* [FEATURE] Support profiles in AWS EC2 service discovery configuration 465* [ENHANCEMENT] Remove duplicated logging of Kubernetes client errors 466* [ENHANCEMENT] Add metrics about Kubernetes service discovery 467* [BUGFIX] Update alert annotations on re-evaluation 468* [BUGFIX] Fix export of group modifier in PromQL queries 469* [BUGFIX] Remove potential deadlocks in several service discovery implementations 470* [BUGFIX] Use proper float64 modulo in PromQL `%` binary operations 471* [BUGFIX] Fix crash bug in Kubernetes service discovery 472 473## 1.3.1 / 2016-11-04 474 475This bug-fix release pulls in the fixes from the 1.2.3 release. 476 477* [BUGFIX] Correctly handle empty Regex entry in relabel config. 478* [BUGFIX] MOD (`%`) operator doesn't panic with small floating point numbers. 479* [BUGFIX] Updated miekg/dns vendoring to pick up upstream bug fixes. 480* [ENHANCEMENT] Improved DNS error reporting. 481 482## 1.2.3 / 2016-11-04 483 484Note that this release is chronologically after 1.3.0. 485 486* [BUGFIX] Correctly handle end time before start time in range queries. 487* [BUGFIX] Error on negative `-storage.staleness-delta` 488* [BUGFIX] Correctly handle empty Regex entry in relabel config. 489* [BUGFIX] MOD (`%`) operator doesn't panic with small floating point numbers. 490* [BUGFIX] Updated miekg/dns vendoring to pick up upstream bug fixes. 491* [ENHANCEMENT] Improved DNS error reporting. 492 493## 1.3.0 / 2016-11-01 494 495This is a breaking change to the Kubernetes service discovery. 496 497* [CHANGE] Rework Kubernetes SD. 498* [FEATURE] Add support for interpolating `target_label`. 499* [FEATURE] Add GCE metadata as Prometheus meta labels. 500* [ENHANCEMENT] Add EC2 SD metrics. 501* [ENHANCEMENT] Add Azure SD metrics. 502* [ENHANCEMENT] Add fuzzy search to `/graph` textarea. 503* [ENHANCEMENT] Always show instance labels on target page. 504* [BUGFIX] Validate query end time is not before start time. 505* [BUGFIX] Error on negative `-storage.staleness-delta` 506 507## 1.2.2 / 2016-10-30 508 509* [BUGFIX] Correctly handle on() in alerts. 510* [BUGFIX] UI: Deal properly with aborted requests. 511* [BUGFIX] UI: Decode URL query parameters properly. 512* [BUGFIX] Storage: Deal better with data corruption (non-monotonic timestamps). 513* [BUGFIX] Remote storage: Re-add accidentally removed timeout flag. 514* [BUGFIX] Updated a number of vendored packages to pick up upstream bug fixes. 515 516## 1.2.1 / 2016-10-10 517 518* [BUGFIX] Count chunk evictions properly so that the server doesn't 519 assume it runs out of memory and subsequencly throttles ingestion. 520* [BUGFIX] Use Go1.7.1 for prebuilt binaries to fix issues on MacOS Sierra. 521 522## 1.2.0 / 2016-10-07 523 524* [FEATURE] Cleaner encoding of query parameters in `/graph` URLs. 525* [FEATURE] PromQL: Add `minute()` function. 526* [FEATURE] Add GCE service discovery. 527* [FEATURE] Allow any valid UTF-8 string as job name. 528* [FEATURE] Allow disabling local storage. 529* [FEATURE] EC2 service discovery: Expose `ec2_instance_state`. 530* [ENHANCEMENT] Various performance improvements in local storage. 531* [BUGFIX] Zookeeper service discovery: Remove deleted nodes. 532* [BUGFIX] Zookeeper service discovery: Resync state after Zookeeper failure. 533* [BUGFIX] Remove JSON from HTTP Accept header. 534* [BUGFIX] Fix flag validation of Alertmanager URL. 535* [BUGFIX] Fix race condition on shutdown. 536* [BUGFIX] Do not fail Consul discovery on Prometheus startup when Consul 537 is down. 538* [BUGFIX] Handle NaN in `changes()` correctly. 539* [CHANGE] **Experimental** remote write path: Remove use of gRPC. 540* [CHANGE] **Experimental** remote write path: Configuration via config file 541 rather than command line flags. 542* [FEATURE] **Experimental** remote write path: Add HTTP basic auth and TLS. 543* [FEATURE] **Experimental** remote write path: Support for relabelling. 544 545## 1.1.3 / 2016-09-16 546 547* [ENHANCEMENT] Use golang-builder base image for tests in CircleCI. 548* [ENHANCEMENT] Added unit tests for federation. 549* [BUGFIX] Correctly de-dup metric families in federation output. 550 551## 1.1.2 / 2016-09-08 552 553* [BUGFIX] Allow label names that coincide with keywords. 554 555## 1.1.1 / 2016-09-07 556 557* [BUGFIX] Fix IPv6 escaping in service discovery integrations 558* [BUGFIX] Fix default scrape port assignment for IPv6 559 560## 1.1.0 / 2016-09-03 561 562* [FEATURE] Add `quantile` and `quantile_over_time`. 563* [FEATURE] Add `stddev_over_time` and `stdvar_over_time`. 564* [FEATURE] Add various time and date functions. 565* [FEATURE] Added `toUpper` and `toLower` formatting to templates. 566* [FEATURE] Allow relabeling of alerts. 567* [FEATURE] Allow URLs in targets defined via a JSON file. 568* [FEATURE] Add idelta function. 569* [FEATURE] 'Remove graph' button on the /graph page. 570* [FEATURE] Kubernetes SD: Add node name and host IP to pod discovery. 571* [FEATURE] New remote storage write path. EXPERIMENTAL! 572* [ENHANCEMENT] Improve time-series index lookups. 573* [ENHANCEMENT] Forbid invalid relabel configurations. 574* [ENHANCEMENT] Improved various tests. 575* [ENHANCEMENT] Add crash recovery metric 'started_dirty'. 576* [ENHANCEMENT] Fix (and simplify) populating series iterators. 577* [ENHANCEMENT] Add job link on target page. 578* [ENHANCEMENT] Message on empty Alerts page. 579* [ENHANCEMENT] Various internal code refactorings and clean-ups. 580* [ENHANCEMENT] Various improvements in the build system. 581* [BUGFIX] Catch errors when unmarshaling delta/doubleDelta encoded chunks. 582* [BUGFIX] Fix data race in lexer and lexer test. 583* [BUGFIX] Trim stray whitespace from bearer token file. 584* [BUGFIX] Avoid divide-by-zero panic on query_range?step=0. 585* [BUGFIX] Detect invalid rule files at startup. 586* [BUGFIX] Fix counter reset treatment in PromQL. 587* [BUGFIX] Fix rule HTML escaping issues. 588* [BUGFIX] Remove internal labels from alerts sent to AM. 589 590## 1.0.2 / 2016-08-24 591 592* [BUGFIX] Clean up old targets after config reload. 593 594## 1.0.1 / 2016-07-21 595 596* [BUGFIX] Exit with error on non-flag command-line arguments. 597* [BUGFIX] Update example console templates to new HTTP API. 598* [BUGFIX] Re-add logging flags. 599 600## 1.0.0 / 2016-07-18 601 602* [CHANGE] Remove deprecated query language keywords 603* [CHANGE] Change Kubernetes SD to require specifying Kubernetes role 604* [CHANGE] Use service address in Consul SD if available 605* [CHANGE] Standardize all Prometheus internal metrics to second units 606* [CHANGE] Remove unversioned legacy HTTP API 607* [CHANGE] Remove legacy ingestion of JSON metric format 608* [CHANGE] Remove deprecated `target_groups` configuration 609* [FEATURE] Add binary power operation to PromQL 610* [FEATURE] Add `count_values` aggregator 611* [FEATURE] Add `-web.route-prefix` flag 612* [FEATURE] Allow `on()`, `by()`, `without()` in PromQL with empty label sets 613* [ENHANCEMENT] Make `topk/bottomk` query functions aggregators 614* [BUGFIX] Fix annotations in alert rule printing 615* [BUGFIX] Expand alert templating at evaluation time 616* [BUGFIX] Fix edge case handling in crash recovery 617* [BUGFIX] Hide testing package flags from help output 618 619## 0.20.0 / 2016-06-15 620 621This release contains multiple breaking changes to the configuration schema. 622 623* [FEATURE] Allow configuring multiple Alertmanagers 624* [FEATURE] Add server name to TLS configuration 625* [FEATURE] Add labels for all node addresses and discover node port if available in Kubernetes SD 626* [ENHANCEMENT] More meaningful configuration errors 627* [ENHANCEMENT] Round scraping timestamps to milliseconds in web UI 628* [ENHANCEMENT] Make number of storage fingerprint locks configurable 629* [BUGFIX] Fix date parsing in console template graphs 630* [BUGFIX] Fix static console files in Docker images 631* [BUGFIX] Fix console JS XHR requests for IE11 632* [BUGFIX] Add missing path prefix in new status page 633* [CHANGE] Rename `target_groups` to `static_configs` in config files 634* [CHANGE] Rename `names` to `files` in file SD configuration 635* [CHANGE] Remove kubelet port config option in Kubernetes SD configuration 636 637## 0.19.3 / 2016-06-14 638 639* [BUGFIX] Handle Marathon apps with zero ports 640* [BUGFIX] Fix startup panic in retrieval layer 641 642## 0.19.2 / 2016-05-29 643 644* [BUGFIX] Correctly handle `GROUP_LEFT` and `GROUP_RIGHT` without labels in 645 string representation of expressions and in rules. 646* [BUGFIX] Use `-web.external-url` for new status endpoints. 647 648## 0.19.1 / 2016-05-25 649 650* [BUGFIX] Handle service discovery panic affecting Kubernetes SD 651* [BUGFIX] Fix web UI display issue in some browsers 652 653## 0.19.0 / 2016-05-24 654 655This version contains a breaking change to the query language. Please read 656the documentation on the grouping behavior of vector matching: 657 658https://prometheus.io/docs/querying/operators/#vector-matching 659 660* [FEATURE] Add experimental Microsoft Azure service discovery 661* [FEATURE] Add `ignoring` modifier for binary operations 662* [FEATURE] Add pod discovery to Kubernetes service discovery 663* [CHANGE] Vector matching takes grouping labels from one-side 664* [ENHANCEMENT] Support time range on /api/v1/series endpoint 665* [ENHANCEMENT] Partition status page into individual pages 666* [BUGFIX] Fix issue of hanging target scrapes 667 668## 0.18.0 / 2016-04-18 669 670* [BUGFIX] Fix operator precedence in PromQL 671* [BUGFIX] Never drop still open head chunk 672* [BUGFIX] Fix missing 'keep_common' when printing AST node 673* [CHANGE/BUGFIX] Target identity considers path and parameters additionally to host and port 674* [CHANGE] Rename metric `prometheus_local_storage_invalid_preload_requests_total` to `prometheus_local_storage_non_existent_series_matches_total` 675* [CHANGE] Support for old alerting rule syntax dropped 676* [FEATURE] Deduplicate targets within the same scrape job 677* [FEATURE] Add varbit chunk encoding (higher compression, more CPU usage – disabled by default) 678* [FEATURE] Add `holt_winters` query function 679* [FEATURE] Add relative complement `unless` operator to PromQL 680* [ENHANCEMENT] Quarantine series file if data corruption is encountered (instead of crashing) 681* [ENHANCEMENT] Validate Alertmanager URL 682* [ENHANCEMENT] Use UTC for build timestamp 683* [ENHANCEMENT] Improve index query performance (especially for active time series) 684* [ENHANCEMENT] Instrument configuration reload duration 685* [ENHANCEMENT] Instrument retrieval layer 686* [ENHANCEMENT] Add Go version to `prometheus_build_info` metric 687 688## 0.17.0 / 2016-03-02 689 690This version no longer works with Alertmanager 0.0.4 and earlier! 691The alerting rule syntax has changed as well but the old syntax is supported 692up until version 0.18. 693 694All regular expressions in PromQL are anchored now, matching the behavior of 695regular expressions in config files. 696 697* [CHANGE] Integrate with Alertmanager 0.1.0 and higher 698* [CHANGE] Degraded storage mode renamed to rushed mode 699* [CHANGE] New alerting rule syntax 700* [CHANGE] Add label validation on ingestion 701* [CHANGE] Regular expression matchers in PromQL are anchored 702* [FEATURE] Add `without` aggregation modifier 703* [FEATURE] Send alert resolved notifications to Alertmanager 704* [FEATURE] Allow millisecond precision in configuration file 705* [FEATURE] Support AirBnB's Smartstack Nerve for service discovery 706* [ENHANCEMENT] Storage switches less often between regular and rushed mode. 707* [ENHANCEMENT] Storage switches into rushed mode if there are too many memory chunks. 708* [ENHANCEMENT] Added more storage instrumentation 709* [ENHANCEMENT] Improved instrumentation of notification handler 710* [BUGFIX] Do not count head chunks as chunks waiting for persistence 711* [BUGFIX] Handle OPTIONS HTTP requests to the API correctly 712* [BUGFIX] Parsing of ranges in PromQL fixed 713* [BUGFIX] Correctly validate URL flag parameters 714* [BUGFIX] Log argument parse errors 715* [BUGFIX] Properly handle creation of target with bad TLS config 716* [BUGFIX] Fix of checkpoint timing issue 717 718## 0.16.2 / 2016-01-18 719 720* [FEATURE] Multiple authentication options for EC2 discovery added 721* [FEATURE] Several meta labels for EC2 discovery added 722* [FEATURE] Allow full URLs in static target groups (used e.g. by the `blackbox_exporter`) 723* [FEATURE] Add Graphite remote-storage integration 724* [FEATURE] Create separate Kubernetes targets for services and their endpoints 725* [FEATURE] Add `clamp_{min,max}` functions to PromQL 726* [FEATURE] Omitted time parameter in API query defaults to now 727* [ENHANCEMENT] Less frequent time series file truncation 728* [ENHANCEMENT] Instrument number of manually deleted time series 729* [ENHANCEMENT] Ignore lost+found directory during storage version detection 730* [CHANGE] Kubernetes `masters` renamed to `api_servers` 731* [CHANGE] "Healthy" and "unhealthy" targets are now called "up" and "down" in the web UI 732* [CHANGE] Remove undocumented 2nd argument of the `delta` function. 733 (This is a BREAKING CHANGE for users of the undocumented 2nd argument.) 734* [BUGFIX] Return proper HTTP status codes on API errors 735* [BUGFIX] Fix Kubernetes authentication configuration 736* [BUGFIX] Fix stripped OFFSET from in rule evaluation and display 737* [BUGFIX] Do not crash on failing Consul SD initialization 738* [BUGFIX] Revert changes to metric auto-completion 739* [BUGFIX] Add config overflow validation for TLS configuration 740* [BUGFIX] Skip already watched Zookeeper nodes in serverset SD 741* [BUGFIX] Don't federate stale samples 742* [BUGFIX] Move NaN to end of result for `topk/bottomk/sort/sort_desc/min/max` 743* [BUGFIX] Limit extrapolation of `delta/rate/increase` 744* [BUGFIX] Fix unhandled error in rule evaluation 745 746Some changes to the Kubernetes service discovery were integration since 747it was released as a beta feature. 748 749## 0.16.1 / 2015-10-16 750 751* [FEATURE] Add `irate()` function. 752* [ENHANCEMENT] Improved auto-completion in expression browser. 753* [CHANGE] Kubernetes SD moves node label to instance label. 754* [BUGFIX] Escape regexes in console templates. 755 756## 0.16.0 / 2015-10-09 757 758BREAKING CHANGES: 759 760* Release tarballs now contain the built binaries in a nested directory. 761* The `hash_mod` relabeling action now uses MD5 hashes instead of FNV hashes to 762 achieve a better distribution. 763* The DNS-SD meta label `__meta_dns_srv_name` was renamed to `__meta_dns_name` 764 to reflect support for DNS record types other than `SRV`. 765* The default full refresh interval for the file-based service discovery has been 766 increased from 30 seconds to 5 minutes. 767* In relabeling, parts of a source label that weren't matched by 768 the specified regular expression are no longer included in the replacement 769 output. 770* Queries no longer interpolate between two data points. Instead, the resulting 771 value will always be the latest value before the evaluation query timestamp. 772* Regular expressions supplied via the configuration are now anchored to match 773 full strings instead of substrings. 774* Global labels are not appended upon storing time series anymore. Instead, 775 they are only appended when communicating with external systems 776 (Alertmanager, remote storages, federation). They have thus also been renamed 777 from `global.labels` to `global.external_labels`. 778* The names and units of metrics related to remote storage sample appends have 779 been changed. 780* The experimental support for writing to InfluxDB has been updated to work 781 with InfluxDB 0.9.x. 0.8.x versions of InfluxDB are not supported anymore. 782* Escape sequences in double- and single-quoted string literals in rules or query 783 expressions are now interpreted like escape sequences in Go string literals 784 (https://golang.org/ref/spec#String_literals). 785 786Future breaking changes / deprecated features: 787 788* The `delta()` function had an undocumented optional second boolean argument 789 to make it behave like `increase()`. This second argument will be removed in 790 the future. Migrate any occurrences of `delta(x, 1)` to use `increase(x)` 791 instead. 792* Support for filter operators between two scalar values (like `2 > 1`) will be 793 removed in the future. These will require a `bool` modifier on the operator, 794 e.g. `2 > bool 1`. 795 796All changes: 797 798* [CHANGE] Renamed `global.labels` to `global.external_labels`. 799* [CHANGE] Vendoring is now done via govendor instead of godep. 800* [CHANGE] Change web UI root page to show the graphing interface instead of 801 the server status page. 802* [CHANGE] Append global labels only when communicating with external systems 803 instead of storing them locally. 804* [CHANGE] Change all regexes in the configuration to do full-string matches 805 instead of substring matches. 806* [CHANGE] Remove interpolation of vector values in queries. 807* [CHANGE] For alert `SUMMARY`/`DESCRIPTION` template fields, cast the alert 808 value to `float64` to work with common templating functions. 809* [CHANGE] In relabeling, don't include unmatched source label parts in the 810 replacement. 811* [CHANGE] Change default full refresh interval for the file-based service 812 discovery from 30 seconds to 5 minutes. 813* [CHANGE] Rename the DNS-SD meta label `__meta_dns_srv_name` to 814 `__meta_dns_name` to reflect support for other record types than `SRV`. 815* [CHANGE] Release tarballs now contain the binaries in a nested directory. 816* [CHANGE] Update InfluxDB write support to work with InfluxDB 0.9.x. 817* [FEATURE] Support full "Go-style" escape sequences in strings and add raw 818 string literals. 819* [FEATURE] Add EC2 service discovery support. 820* [FEATURE] Allow configuring TLS options in scrape configurations. 821* [FEATURE] Add instrumentation around configuration reloads. 822* [FEATURE] Add `bool` modifier to comparison operators to enable boolean 823 (`0`/`1`) output instead of filtering. 824* [FEATURE] In Zookeeper serverset discovery, provide `__meta_serverset_shard` 825 label with the serverset shard number. 826* [FEATURE] Provide `__meta_consul_service_id` meta label in Consul service 827 discovery. 828* [FEATURE] Allow scalar expressions in recording rules to enable use cases 829 such as building constant metrics. 830* [FEATURE] Add `label_replace()` and `vector()` query language functions. 831* [FEATURE] In Consul service discovery, fill in the `__meta_consul_dc` 832 datacenter label from the Consul agent when it's not set in the Consul SD 833 config. 834* [FEATURE] Scrape all services upon empty services list in Consul service 835 discovery. 836* [FEATURE] Add `labelmap` relabeling action to map a set of input labels to a 837 set of output labels using regular expressions. 838* [FEATURE] Introduce `__tmp` as a relabeling label prefix that is guaranteed 839 to not be used by Prometheus internally. 840* [FEATURE] Kubernetes-based service discovery. 841* [FEATURE] Marathon-based service discovery. 842* [FEATURE] Support multiple series names in console graphs JavaScript library. 843* [FEATURE] Allow reloading configuration via web handler at `/-/reload`. 844* [FEATURE] Updates to promtool to reflect new Prometheus configuration 845 features. 846* [FEATURE] Add `proxy_url` parameter to scrape configurations to enable use of 847 proxy servers. 848* [FEATURE] Add console templates for Prometheus itself. 849* [FEATURE] Allow relabeling the protocol scheme of targets. 850* [FEATURE] Add `predict_linear()` query language function. 851* [FEATURE] Support for authentication using bearer tokens, client certs, and 852 CA certs. 853* [FEATURE] Implement unary expressions for vector types (`-foo`, `+foo`). 854* [FEATURE] Add console templates for the SNMP exporter. 855* [FEATURE] Make it possible to relabel target scrape query parameters. 856* [FEATURE] Add support for `A` and `AAAA` records in DNS service discovery. 857* [ENHANCEMENT] Fix several flaky tests. 858* [ENHANCEMENT] Switch to common routing package. 859* [ENHANCEMENT] Use more resilient metric decoder. 860* [ENHANCEMENT] Update vendored dependencies. 861* [ENHANCEMENT] Add compression to more HTTP handlers. 862* [ENHANCEMENT] Make -web.external-url flag help string more verbose. 863* [ENHANCEMENT] Improve metrics around remote storage queues. 864* [ENHANCEMENT] Use Go 1.5.1 instead of Go 1.4.2 in builds. 865* [ENHANCEMENT] Update the architecture diagram in the `README.md`. 866* [ENHANCEMENT] Time out sample appends in retrieval layer if the storage is 867 backlogging. 868* [ENHANCEMENT] Make `hash_mod` relabeling action use MD5 instead of FNV to 869 enable better hash distribution. 870* [ENHANCEMENT] Better tracking of targets between same service discovery 871 mechanisms in one scrape configuration. 872* [ENHANCEMENT] Handle parser and query evaluation runtime panics more 873 gracefully. 874* [ENHANCEMENT] Add IDs to H2 tags on status page to allow anchored linking. 875* [BUGFIX] Fix watching multiple paths with Zookeeper serverset discovery. 876* [BUGFIX] Fix high CPU usage on configuration reload. 877* [BUGFIX] Fix disappearing `__params` on configuration reload. 878* [BUGFIX] Make `labelmap` action available through configuration. 879* [BUGFIX] Fix direct access of protobuf fields. 880* [BUGFIX] Fix panic on Consul request error. 881* [BUGFIX] Redirect of graph endpoint for prefixed setups. 882* [BUGFIX] Fix series file deletion behavior when purging archived series. 883* [BUGFIX] Fix error checking and logging around checkpointing. 884* [BUGFIX] Fix map initialization in target manager. 885* [BUGFIX] Fix draining of file watcher events in file-based service discovery. 886* [BUGFIX] Add `POST` handler for `/debug` endpoints to fix CPU profiling. 887* [BUGFIX] Fix several flaky tests. 888* [BUGFIX] Fix busylooping in case a scrape configuration has no target 889 providers defined. 890* [BUGFIX] Fix exit behavior of static target provider. 891* [BUGFIX] Fix configuration reloading loop upon shutdown. 892* [BUGFIX] Add missing check for nil expression in expression parser. 893* [BUGFIX] Fix error handling bug in test code. 894* [BUGFIX] Fix Consul port meta label. 895* [BUGFIX] Fix lexer bug that treated non-Latin Unicode digits as digits. 896* [CLEANUP] Remove obsolete federation example from console templates. 897* [CLEANUP] Remove duplicated Bootstrap JS inclusion on graph page. 898* [CLEANUP] Switch to common log package. 899* [CLEANUP] Update build environment scripts and Makefiles to work better with 900 native Go build mechanisms and new Go 1.5 experimental vendoring support. 901* [CLEANUP] Remove logged notice about 0.14.x configuration file format change. 902* [CLEANUP] Move scrape-time metric label modification into SampleAppenders. 903* [CLEANUP] Switch from `github.com/client_golang/model` to 904 `github.com/common/model` and related type cleanups. 905* [CLEANUP] Switch from `github.com/client_golang/extraction` to 906 `github.com/common/expfmt` and related type cleanups. 907* [CLEANUP] Exit Prometheus when the web server encounters a startup error. 908* [CLEANUP] Remove non-functional alert-silencing links on alerting page. 909* [CLEANUP] General cleanups to comments and code, derived from `golint`, 910 `go vet`, or otherwise. 911* [CLEANUP] When entering crash recovery, tell users how to cleanly shut down 912 Prometheus. 913* [CLEANUP] Remove internal support for multi-statement queries in query engine. 914* [CLEANUP] Update AUTHORS.md. 915* [CLEANUP] Don't warn/increment metric upon encountering equal timestamps for 916 the same series upon append. 917* [CLEANUP] Resolve relative paths during configuration loading. 918 919## 0.15.1 / 2015-07-27 920* [BUGFIX] Fix vector matching behavior when there is a mix of equality and 921 non-equality matchers in a vector selector and one matcher matches no series. 922* [ENHANCEMENT] Allow overriding `GOARCH` and `GOOS` in Makefile.INCLUDE. 923* [ENHANCEMENT] Update vendored dependencies. 924 925## 0.15.0 / 2015-07-21 926 927BREAKING CHANGES: 928 929* Relative paths for rule files are now evaluated relative to the config file. 930* External reachability flags (`-web.*`) consolidated. 931* The default storage directory has been changed from `/tmp/metrics` 932 to `data` in the local directory. 933* The `rule_checker` tool has been replaced by `promtool` with 934 different flags and more functionality. 935* Empty labels are now removed upon ingestion into the 936 storage. Matching empty labels is now equivalent to matching unset 937 labels (`mymetric{label=""}` now matches series that don't have 938 `label` set at all). 939* The special `__meta_consul_tags` label in Consul service discovery 940 now starts and ends with tag separators to enable easier regex 941 matching. 942* The default scrape interval has been changed back from 1 minute to 943 10 seconds. 944 945All changes: 946 947* [CHANGE] Change default storage directory to `data` in the current 948 working directory. 949* [CHANGE] Consolidate external reachability flags (`-web.*`)into one. 950* [CHANGE] Deprecate `keeping_extra` modifier keyword, rename it to 951 `keep_common`. 952* [CHANGE] Improve label matching performance and treat unset labels 953 like empty labels in label matchers. 954* [CHANGE] Remove `rule_checker` tool and add generic `promtool` CLI 955 tool which allows checking rules and configuration files. 956* [CHANGE] Resolve rule files relative to config file. 957* [CHANGE] Restore default ScrapeInterval of 1 minute instead of 10 seconds. 958* [CHANGE] Surround `__meta_consul_tags` value with tag separators. 959* [CHANGE] Update node disk console for new filesystem labels. 960* [FEATURE] Add Consul's `ServiceAddress`, `Address`, and `ServicePort` as 961 meta labels to enable setting a custom scrape address if needed. 962* [FEATURE] Add `hashmod` relabel action to allow for horizontal 963 sharding of Prometheus servers. 964* [FEATURE] Add `honor_labels` scrape configuration option to not 965 overwrite any labels exposed by the target. 966* [FEATURE] Add basic federation support on `/federate`. 967* [FEATURE] Add optional `RUNBOOK` field to alert statements. 968* [FEATURE] Add pre-relabel target labels to status page. 969* [FEATURE] Add version information endpoint under `/version`. 970* [FEATURE] Added initial stable API version 1 under `/api/v1`, 971 including ability to delete series and query more metadata. 972* [FEATURE] Allow configuring query parameters when scraping metrics endpoints. 973* [FEATURE] Allow deleting time series via the new v1 API. 974* [FEATURE] Allow individual ingested metrics to be relabeled. 975* [FEATURE] Allow loading rule files from an entire directory. 976* [FEATURE] Allow scalar expressions in range queries, improve error messages. 977* [FEATURE] Support Zookeeper Serversets as a service discovery mechanism. 978* [ENHANCEMENT] Add circleci yaml for Dockerfile test build. 979* [ENHANCEMENT] Always show selected graph range, regardless of available data. 980* [ENHANCEMENT] Change expression input field to multi-line textarea. 981* [ENHANCEMENT] Enforce strict monotonicity of time stamps within a series. 982* [ENHANCEMENT] Export build information as metric. 983* [ENHANCEMENT] Improve UI of `/alerts` page. 984* [ENHANCEMENT] Improve display of target labels on status page. 985* [ENHANCEMENT] Improve initialization and routing functionality of web service. 986* [ENHANCEMENT] Improve target URL handling and display. 987* [ENHANCEMENT] New dockerfile using alpine-glibc base image and make. 988* [ENHANCEMENT] Other minor fixes. 989* [ENHANCEMENT] Preserve alert state across reloads. 990* [ENHANCEMENT] Prettify flag help output even more. 991* [ENHANCEMENT] README.md updates. 992* [ENHANCEMENT] Raise error on unknown config parameters. 993* [ENHANCEMENT] Refine v1 HTTP API output. 994* [ENHANCEMENT] Show original configuration file contents on status 995 page instead of serialized YAML. 996* [ENHANCEMENT] Start HUP signal handler earlier to not exit upon HUP 997 during startup. 998* [ENHANCEMENT] Updated vendored dependencies. 999* [BUGFIX] Do not panic in `StringToDuration()` on wrong duration unit. 1000* [BUGFIX] Exit on invalid rule files on startup. 1001* [BUGFIX] Fix a regression in the `.Path` console template variable. 1002* [BUGFIX] Fix chunk descriptor loading. 1003* [BUGFIX] Fix consoles "Prometheus" link to point to / 1004* [BUGFIX] Fix empty configuration file cases 1005* [BUGFIX] Fix float to int conversions in chunk encoding, which were 1006 broken for some architectures. 1007* [BUGFIX] Fix overflow detection for serverset config. 1008* [BUGFIX] Fix race conditions in retrieval layer. 1009* [BUGFIX] Fix shutdown deadlock in Consul SD code. 1010* [BUGFIX] Fix the race condition targets in the Makefile. 1011* [BUGFIX] Fix value display error in web console. 1012* [BUGFIX] Hide authentication credentials in config `String()` output. 1013* [BUGFIX] Increment dirty counter metric in storage only if 1014 `setDirty(true)` is called. 1015* [BUGFIX] Periodically refresh services in Consul to recover from 1016 missing events. 1017* [BUGFIX] Prevent overwrite of default global config when loading a 1018 configuration. 1019* [BUGFIX] Properly lex `\r` as whitespace in expression language. 1020* [BUGFIX] Validate label names in JSON target groups. 1021* [BUGFIX] Validate presence of regex field in relabeling configurations. 1022* [CLEANUP] Clean up initialization of remote storage queues. 1023* [CLEANUP] Fix `go vet` and `golint` violations. 1024* [CLEANUP] General cleanup of rules and query language code. 1025* [CLEANUP] Improve and simplify Dockerfile build steps. 1026* [CLEANUP] Improve and simplify build infrastructure, use go-bindata 1027 for web assets. Allow building without git. 1028* [CLEANUP] Move all utility packages into common `util` subdirectory. 1029* [CLEANUP] Refactor main, flag handling, and web package. 1030* [CLEANUP] Remove unused methods from `Rule` interface. 1031* [CLEANUP] Simplify default config handling. 1032* [CLEANUP] Switch human-readable times on web UI to UTC. 1033* [CLEANUP] Use `templates.TemplateExpander` for all page templates. 1034* [CLEANUP] Use new v1 HTTP API for querying and graphing. 1035 1036## 0.14.0 / 2015-06-01 1037* [CHANGE] Configuration format changed and switched to YAML. 1038 (See the provided [migration tool](https://github.com/prometheus/migrate/releases).) 1039* [ENHANCEMENT] Redesign of state-preserving target discovery. 1040* [ENHANCEMENT] Allow specifying scrape URL scheme and basic HTTP auth for non-static targets. 1041* [FEATURE] Allow attaching meaningful labels to targets via relabeling. 1042* [FEATURE] Configuration/rule reloading at runtime. 1043* [FEATURE] Target discovery via file watches. 1044* [FEATURE] Target discovery via Consul. 1045* [ENHANCEMENT] Simplified binary operation evaluation. 1046* [ENHANCEMENT] More stable component initialization. 1047* [ENHANCEMENT] Added internal expression testing language. 1048* [BUGFIX] Fix graph links with path prefix. 1049* [ENHANCEMENT] Allow building from source without git. 1050* [ENHANCEMENT] Improve storage iterator performance. 1051* [ENHANCEMENT] Change logging output format and flags. 1052* [BUGFIX] Fix memory alignment bug for 32bit systems. 1053* [ENHANCEMENT] Improve web redirection behavior. 1054* [ENHANCEMENT] Allow overriding default hostname for Prometheus URLs. 1055* [BUGFIX] Fix double slash in URL sent to alertmanager. 1056* [FEATURE] Add resets() query function to count counter resets. 1057* [FEATURE] Add changes() query function to count the number of times a gauge changed. 1058* [FEATURE] Add increase() query function to calculate a counter's increase. 1059* [ENHANCEMENT] Limit retrievable samples to the storage's retention window. 1060 1061## 0.13.4 / 2015-05-23 1062* [BUGFIX] Fix a race while checkpointing fingerprint mappings. 1063 1064## 0.13.3 / 2015-05-11 1065* [BUGFIX] Handle fingerprint collisions properly. 1066* [CHANGE] Comments in rules file must start with `#`. (The undocumented `//` 1067 and `/*...*/` comment styles are no longer supported.) 1068* [ENHANCEMENT] Switch to custom expression language parser and evaluation 1069 engine, which generates better error messages, fixes some parsing edge-cases, 1070 and enables other future enhancements (like the ones below). 1071* [ENHANCEMENT] Limit maximum number of concurrent queries. 1072* [ENHANCEMENT] Terminate running queries during shutdown. 1073 1074## 0.13.2 / 2015-05-05 1075* [MAINTENANCE] Updated vendored dependencies to their newest versions. 1076* [MAINTENANCE] Include rule_checker and console templates in release tarball. 1077* [BUGFIX] Sort NaN as the lowest value. 1078* [ENHANCEMENT] Add square root, stddev and stdvar functions. 1079* [BUGFIX] Use scrape_timeout for scrape timeout, not scrape_interval. 1080* [ENHANCEMENT] Improve chunk and chunkDesc loading, increase performance when 1081 reading from disk. 1082* [BUGFIX] Show correct error on wrong DNS response. 1083 1084## 0.13.1 / 2015-04-09 1085* [BUGFIX] Treat memory series with zero chunks correctly in series maintenance. 1086* [ENHANCEMENT] Improve readability of usage text even more. 1087 1088## 0.13.0 / 2015-04-08 1089* [ENHANCEMENT] Double-delta encoding for chunks, saving typically 40% of 1090 space, both in RAM and on disk. 1091* [ENHANCEMENT] Redesign of chunk persistence queuing, increasing performance 1092 on spinning disks significantly. 1093* [ENHANCEMENT] Redesign of sample ingestion, increasing ingestion performance. 1094* [FEATURE] Added ln, log2, log10 and exp functions to the query language. 1095* [FEATURE] Experimental write support to InfluxDB. 1096* [FEATURE] Allow custom timestamps in instant query API. 1097* [FEATURE] Configurable path prefix for URLs to support proxies. 1098* [ENHANCEMENT] Increase of rule_checker CLI usability. 1099* [CHANGE] Show special float values as gaps. 1100* [ENHANCEMENT] Made usage output more readable. 1101* [ENHANCEMENT] Increased resilience of the storage against data corruption. 1102* [ENHANCEMENT] Various improvements around chunk encoding. 1103* [ENHANCEMENT] Nicer formatting of target health table on /status. 1104* [CHANGE] Rename UNREACHABLE to UNHEALTHY, ALIVE to HEALTHY. 1105* [BUGFIX] Strip trailing slash in alertmanager URL. 1106* [BUGFIX] Avoid +InfYs and similar, just display +Inf. 1107* [BUGFIX] Fixed HTML-escaping at various places. 1108* [BUGFIX] Fixed special value handling in division and modulo of the query 1109 language. 1110* [BUGFIX] Fix embed-static.sh. 1111* [CLEANUP] Added initial HTTP API tests. 1112* [CLEANUP] Misc. other code cleanups. 1113* [MAINTENANCE] Updated vendored dependencies to their newest versions. 1114 1115## 0.12.0 / 2015-03-04 1116* [CHANGE] Use client_golang v0.3.1. THIS CHANGES FINGERPRINTING AND INVALIDATES 1117 ALL PERSISTED FINGERPRINTS. You have to wipe your storage to use this or 1118 later versions. There is a version guard in place that will prevent you to 1119 run Prometheus with the stored data of an older Prometheus. 1120* [BUGFIX] The change above fixes a weakness in the fingerprinting algorithm. 1121* [ENHANCEMENT] The change above makes fingerprinting faster and less allocation 1122 intensive. 1123* [FEATURE] OR operator and vector matching options. See docs for details. 1124* [ENHANCEMENT] Scientific notation and special float values (Inf, NaN) now 1125 supported by the expression language. 1126* [CHANGE] Dockerfile makes Prometheus use the Docker volume to store data 1127 (rather than /tmp/metrics). 1128* [CHANGE] Makefile uses Go 1.4.2. 1129 1130## 0.11.1 / 2015-02-27 1131* [BUGFIX] Make series maintenance complete again. (Ever since 0.9.0rc4, 1132 or commit 0851945, series would not be archived, chunk descriptors would 1133 not be evicted, and stale head chunks would never be closed. This happened 1134 due to accidental deletion of a line calling a (well tested :) function. 1135* [BUGFIX] Do not double count head chunks read from checkpoint on startup. 1136 Also fix a related but less severe bug in counting chunk descriptors. 1137* [BUGFIX] Check last time in head chunk for head chunk timeout, not first. 1138* [CHANGE] Update vendoring due to vendoring changes in client_golang. 1139* [CLEANUP] Code cleanups. 1140* [ENHANCEMENT] Limit the number of 'dirty' series counted during checkpointing. 1141 1142## 0.11.0 / 2015-02-23 1143* [FEATURE] Introduce new metric type Histogram with server-side aggregation. 1144* [FEATURE] Add offset operator. 1145* [FEATURE] Add floor, ceil and round functions. 1146* [CHANGE] Change instance identifiers to be host:port. 1147* [CHANGE] Dependency management and vendoring changed/improved. 1148* [CHANGE] Flag name changes to create consistency between various Prometheus 1149 binaries. 1150* [CHANGE] Show unlimited number of metrics in autocomplete. 1151* [CHANGE] Add query timeout. 1152* [CHANGE] Remove labels on persist error counter. 1153* [ENHANCEMENT] Various performance improvements for sample ingestion. 1154* [ENHANCEMENT] Various Makefile improvements. 1155* [ENHANCEMENT] Various console template improvements, including 1156 proof-of-concept for federation via console templates. 1157* [ENHANCEMENT] Fix graph JS glitches and simplify graphing code. 1158* [ENHANCEMENT] Dramatically decrease resources for file embedding. 1159* [ENHANCEMENT] Crash recovery saves lost series data in 'orphaned' directory. 1160* [BUGFIX] Fix aggregation grouping key calculation. 1161* [BUGFIX] Fix Go download path for various architectures. 1162* [BUGFIX] Fixed the link of the Travis build status image. 1163* [BUGFIX] Fix Rickshaw/D3 version mismatch. 1164* [CLEANUP] Various code cleanups. 1165 1166## 0.10.0 / 2015-01-26 1167* [CHANGE] More efficient JSON result format in query API. This requires 1168 up-to-date versions of PromDash and prometheus_cli, too. 1169* [ENHANCEMENT] Excluded non-minified Bootstrap assets and the Bootstrap maps 1170 from embedding into the binary. Those files are only used for debugging, 1171 and then you can use -web.use-local-assets. By including fewer files, the 1172 RAM usage during compilation is much more manageable. 1173* [ENHANCEMENT] Help link points to http://prometheus.github.io now. 1174* [FEATURE] Consoles for haproxy and cloudwatch. 1175* [BUGFIX] Several fixes to graphs in consoles. 1176* [CLEANUP] Removed a file size check that did not check anything. 1177 1178## 0.9.0 / 2015-01-23 1179* [CHANGE] Reworked command line flags, now more consistent and taking into 1180 account needs of the new storage backend (see below). 1181* [CHANGE] Metric names are dropped after certain transformations. 1182* [CHANGE] Changed partitioning of summary metrics exported by Prometheus. 1183* [CHANGE] Got rid of Gerrit as a review tool. 1184* [CHANGE] 'Tabular' view now the default (rather than 'Graph') to avoid 1185 running very expensive queries accidentally. 1186* [CHANGE] On-disk format for stored samples changed. For upgrading, you have 1187 to nuke your old files completely. See "Complete rewrite of the storage 1188* [CHANGE] Removed 2nd argument from `delta`. 1189* [FEATURE] Added a `deriv` function. 1190* [FEATURE] Console templates. 1191* [FEATURE] Added `absent` function. 1192* [FEATURE] Allow omitting the metric name in queries. 1193* [BUGFIX] Removed all known race conditions. 1194* [BUGFIX] Metric mutations now handled correctly in all cases. 1195* [ENHANCEMENT] Proper double-start protection. 1196* [ENHANCEMENT] Complete rewrite of the storage layer. Benefits include: 1197 * Better query performance. 1198 * More samples in less RAM. 1199 * Better memory management. 1200 * Scales up to millions of time series and thousands of samples ingested 1201 per second. 1202 * Purging of obsolete samples much cleaner now, up to completely 1203 "forgetting" obsolete time series. 1204 * Proper instrumentation to diagnose the storage layer with... well... 1205 Prometheus. 1206 * Pure Go implementation, no need for cgo and shared C libraries anymore. 1207 * Better concurrency. 1208* [ENHANCEMENT] Copy-on-write semantics in the AST layer. 1209* [ENHANCEMENT] Switched from Go 1.3 to Go 1.4. 1210* [ENHANCEMENT] Vendored external dependencies with godeps. 1211* [ENHANCEMENT] Numerous Web UI improvements, moved to Bootstrap3 and 1212 Rickshaw 1.5.1. 1213* [ENHANCEMENT] Improved Docker integration. 1214* [ENHANCEMENT] Simplified the Makefile contraption. 1215* [CLEANUP] Put meta-data files into proper shape (LICENSE, README.md etc.) 1216* [CLEANUP] Removed all legitimate 'go vet' and 'golint' warnings. 1217* [CLEANUP] Removed dead code. 1218 1219## 0.8.0 / 2014-09-04 1220* [ENHANCEMENT] Stagger scrapes to spread out load. 1221* [BUGFIX] Correctly quote HTTP Accept header. 1222 1223## 0.7.0 / 2014-08-06 1224* [FEATURE] Added new functions: abs(), topk(), bottomk(), drop_common_labels(). 1225* [FEATURE] Let console templates get graph links from expressions. 1226* [FEATURE] Allow console templates to dynamically include other templates. 1227* [FEATURE] Template consoles now have access to their URL. 1228* [BUGFIX] Fixed time() function to return evaluation time, not wallclock time. 1229* [BUGFIX] Fixed HTTP connection leak when targets returned a non-200 status. 1230* [BUGFIX] Fixed link to console templates in UI. 1231* [PERFORMANCE] Removed extra memory copies while scraping targets. 1232* [ENHANCEMENT] Switched from Go 1.2.1 to Go 1.3. 1233* [ENHANCEMENT] Made metrics exported by Prometheus itself more consistent. 1234* [ENHANCEMENT] Removed incremental backoffs for unhealthy targets. 1235* [ENHANCEMENT] Dockerfile also builds Prometheus support tools now. 1236 1237## 0.6.0 / 2014-06-30 1238* [FEATURE] Added console and alert templates support, along with various template functions. 1239* [PERFORMANCE] Much faster and more memory-efficient flushing to disk. 1240* [ENHANCEMENT] Query results are now only logged when debugging. 1241* [ENHANCEMENT] Upgraded to new Prometheus client library for exposing metrics. 1242* [BUGFIX] Samples are now kept in memory until fully flushed to disk. 1243* [BUGFIX] Non-200 target scrapes are now treated as an error. 1244* [BUGFIX] Added installation step for missing dependency to Dockerfile. 1245* [BUGFIX] Removed broken and unused "User Dashboard" link. 1246 1247## 0.5.0 / 2014-05-28 1248 1249* [BUGFIX] Fixed next retrieval time display on status page. 1250* [BUGFIX] Updated some variable references in tools subdir. 1251* [FEATURE] Added support for scraping metrics via the new text format. 1252* [PERFORMANCE] Improved label matcher performance. 1253* [PERFORMANCE] Removed JSON indentation in query API, leading to smaller response sizes. 1254* [ENHANCEMENT] Added internal check to verify temporal order of streams. 1255* [ENHANCEMENT] Some internal refactorings. 1256 1257## 0.4.0 / 2014-04-17 1258 1259* [FEATURE] Vectors and scalars may now be reversed in binary operations (`<scalar> <binop> <vector>`). 1260* [FEATURE] It's possible to shutdown Prometheus via a `/-/quit` web endpoint now. 1261* [BUGFIX] Fix for a deadlock race condition in the memory storage. 1262* [BUGFIX] Mac OS X build fixed. 1263* [BUGFIX] Built from Go 1.2.1, which has internal fixes to race conditions in garbage collection handling. 1264* [ENHANCEMENT] Internal storage interface refactoring that allows building e.g. the `rule_checker` tool without LevelDB dynamic library dependencies. 1265* [ENHANCEMENT] Cleanups around shutdown handling. 1266* [PERFORMANCE] Preparations for better memory reuse during marshaling / unmarshaling. 1267