1-------------------------------------------------------------------- 2ChangeLog for Privoxy 3-------------------------------------------------------------------- 4*** Version 3.0.33 stable *** 5- Security/Reliability: 6 - cgi_error_no_template(): Encode the template name to prevent 7 XSS (cross-side scripting) when Privoxy is configured to servce 8 the user-manual itself. 9 Commit 0e668e9409c. OVE-20211102-0001. CVE-2021-44543. 10 Reported by: Artem Ivanov 11 - get_url_spec_param(): Free memory of compiled pattern spec 12 before bailing. 13 Reported by Joshua Rogers (Opera) who also provided the fix. 14 Commit 652b4b7cb0. OVE-20211201-0003. CVE-2021-44540. 15 - process_encrypted_request_headers(): Free header memory when 16 failing to get the request destination. 17 Reported by Joshua Rogers (Opera) who also provided the fix. 18 Commit 0509c58045. OVE-20211201-0002. CVE-2021-44541. 19 - send_http_request(): Prevent memory leaks when handling errors 20 Reported by Joshua Rogers (Opera) who also provided the fix. 21 Commit c48d1d6d08. OVE-20211201-0001. CVE-2021-44542. 22 23- Bug fixes: 24 - handle_established_connection(): Skip the poll()/select() calls 25 if TLS data is pending on the server socket. The TLS library may 26 have already consumed all the data from the server response in 27 which case poll() and select() will not detect that data is 28 available to be read. 29 Fixes SF bug #926 reported by Wen Yue. 30 - continue_https_chat(): Update csp->server_connection.request_sent 31 after sending the request to make sure the latency is calculated 32 correctly. Previously https connections were not reused after 33 timeout seconds after the first request made on the connection. 34 - free_pattern_spec(): Don't try to free an invalid pointer 35 when unloading an action file with a TAG pattern while 36 Privoxy has been compiled without FEATURE_PCRE_HOST_PATTERNS. 37 Closes: SF patch request #147. Patch by Maxim Antonov. 38 - Adjust build_request_line() to create a CONNECT request line when 39 https-inspecting and forwarding to a HTTP proxy. 40 Fixes SF bug #925 reported by Wen Yue. 41 - load_config(): Add a space that was missing in a log message. 42 - read_http_request_body(): Fix two error messages that used an 43 incorrect variable. 44 - If the the response is chunk-encoded, ignore the Content-Length 45 header sent by the server. 46 Allows to load https://redmine.lighttpd.net/ with filtering enabled. 47 48- General improvements: 49 - Allow to edit the add-header action through the CGI editor by 50 generalizing the code that got added with the suppress-tag action. 51 Closes SF patch request #146. Patch by Maxim Antonov. 52 - Add a CGI handler for /wpad.dat that returns a 53 Proxy Auto-Configuration (PAC) file. 54 Among other things, it can be used to instruct clients 55 through DHCP to use Privoxy as proxy. 56 For example with the dnsmasq option: 57 dhcp-option=252,http://config.privoxy.org/wpad.dat 58 Initial patch by Richard Schneidt. 59 - Don't log the applied actions in process_encrypted_request() 60 Log them in continue_https_chat() instead to mirror chat(). 61 Prevents the applied actions from getting logged twice 62 for the first request on an https-inspected connection. 63 - OpenSSL generate_host_certificate(): Use config.privoxy.org as Common Name 64 Org and Org Unit if the real host name is too long to get accepted by OpenSSL. 65 Clients should only care about the Subject Alternative Name 66 anyway and we can continue to use the real host name for it. 67 Reported by Miles Wen on privoxy-users@. 68 - Establish the TLS connection with the client earlier and decide 69 how to route the request afterwards. This allows to change the 70 forwarding settings based on information from the https-inspected 71 request, for example the path. 72 - listen_loop(): When shutting down gracefully, close listening ports 73 before waiting for the threads to exit. Allows to start a second 74 Privoxy with the same config file while the first Privoxy is still 75 running. 76 - serve(): Close the client socket as well if the server socket 77 for an inspected connection has been closed. Privoxy currently 78 can't establish a new server connection when the client socket 79 is reused and would drop the connection in continue_https_chat() 80 anyway. 81 - Don't disable redirect checkers in redirect_url(). 82 Disable them in handle_established_connection() instead. 83 Doing it in redirect_url() prevented the +redirect{} and 84 +fast-redirects{} actions from being logged with LOG_LEVEL_ACTIONS. 85 - handle_established_connection(): Slightly improve a comment. 86 - handle_established_connection(): Fix a comment. 87 - socks5_connect(): Fix indentation. 88 - handle_established_connection(): Improve an error message. 89 - create_pattern_spec(): Fix ifdef indentation. 90 - Fix comment typos. 91 - process_encrypted_request(): Improve a log message. 92 The function only processes request headers and there 93 may still be unread request body data left to process. 94 - chat(): Log the applied actions before deciding how to forward the request. 95 - parse_time_header(): Silence a coverity complaint when building without assertions. 96 - receive_encrypted_request_headers(): Improve a log message. 97 - mbedTLS get_ciphersuites_from_string(): Use strlcpy() instead of strncpy(). 98 Previously the terminating NUL wasn't copied which resulted 99 in a compiler warning. This didn't cause actual problems as 100 the target buffer was initialized by zalloc_or_die() so the 101 last byte of the target buffer was NUL already. 102 Actually copying the terminating NUL seems clearer, though. 103 - Remove compiler warnings. "log_error(LOG_LEVEL_FATAL, ..." 104 doesn't return but apparently the compiler doesn't know that. 105 Get rid of several "this statement may fall through 106 [-Wimplicit-fallthrough=]" warnings. 107 - Store the PEM certificate in a dynamically allocated buffer 108 when https-inspecting. Should prevent errors like: 109 2021-03-16 22:36:19.148 7f47bbfff700 Error: X509 PEM cert len 16694 is larger than buffer len 16383 110 As a bonus it should slightly reduce the memory usage as most 111 certificates are smaller than the previously used fixed buffer. 112 Reported by: Wen Yue 113 - OpenSSL generate_host_certificate(): Fix two error messsages. 114 - Improve description of handle_established_connection() 115 - OpenSSL ssl_store_cert(): Translate EVP_PKEY_EC to a string. 116 - OpenSSL ssl_store_cert(): Remove pointless variable initialization. 117 - OpenSSL ssl_store_cert(): Initialize pointer with NULL instead of 0. 118 119- Action file improvements: 120 - Disable fast-redirects for .microsoftonline.com/. 121 - Disable fast-redirects for idp.springer.com/. 122 - Disable fast-redirects for .zeit.de/zustimmung. 123 - Unblock adv-archiv.dfn-cert.de/. 124 - Block requests to eu-tlp01.kameleoon.eu/. 125 - Block requests to fpa-events.arstechnica.com/. 126 - Unblock nlnet.nl/. 127 - Unblock adguard.com/. 128 129- Privoxy-Log-Parser: 130 - Highlight 'Socket timeout 3 reached: http://127.0.0.1:20000/no-filter/chunked-content/36'. 131 - Improve documentation for inactivity-detection mode. 132 - Detect date changes when looking for inactivity. 133 - Add a --passed-request-statistics-threshold option 134 that can be set to get statistics for requests that 135 were passed. 136 - Add a "inactivity detection" mode which can be useful 137 for debugging purposes. 138 - Bump version to 0.9.4. 139 - Only run print_intro() and print_outro() when syntax highlighting. 140 - Rephrase a sentence in the documentation. 141 - Highlight 'Client socket 7 is no longer usable. The server socket has been closed.'. 142 - Clarify --statistics output by explicitly mentioning that 143 the status codes sent by the server may differ from the ones 144 in "debug 512" messages. 145 - Fix typo in the --statistics output. 146 - Remove an unused variable. 147 - Highlight 'The peer notified us that the connection on socket 11 is going to be closed'. 148 149- Privoxy-Regression-Test: 150 - Remove duplicated word in a comment. 151 152- regression-tests.action: 153 - Add fetch test for http://p.p/wpad.dat. 154 - Bump for-privoxy-version to 3.0.33 which introduced the wpad.dat support. 155 - Add more tests for the '/send-banner' code. 156 - Add test for OVE-20210203-0001. 157 - Add a test for CVE-2021-20217. 158 159- uagen: 160 - Bump generated Firefox version to 91 (ESR). 161 - Bump version to 1.2.3. 162 - Bump copyright. 163 164- Build system: 165 - configure: Bump SOURCE_DATE_EPOCH. 166 - GNUmakefile.in: Fix typo. 167 - configure: Add another warning in case --disable-pthread 168 is used while POSIX threads are available. 169 Various features don't even compile when not using threads. 170 - Add configure option to enable MemorySanitizer. 171 - Add configure option to enable UndefinedBehaviorSanitizer. 172 - Add configure option to enable AddressSanitizer. 173 - Bump copyright. 174 - Add a configure option to disable pcre JIT compilation. 175 While JIT compilation makes filtering faster it can 176 cause false-positive valgrind complaints. 177 As reported by Gwyn Ciesla in SF bug 924 it also can 178 cause problems when the SELinux policy does not grant 179 Privoxy "execmem" privileges. 180 - configure: Remove obsolete RPM_BASE check. 181 182- Windows build system: 183 - Update the build script to use mbed tls version 2.6.11. 184 - Update build script to use the final 8.45 pcre library. 185 - Put all the '--enable-xxx' options in the configure call together. 186 187- macOS build system: 188 - The OSXPackageBuilder repository has been updated and 189 can be used to create macOS packages again. 190 191- Documentation: 192 - contacting: Remove obsolete reference to announce.sgml. 193 - contacting: Request that the browser cache is cleared before 194 producing a log file for submission. 195 - Sponsor FAQ: Note that Privoxy users may follow sponsor links 196 without Referer header set. 197 - newfeatures: Clarify that https inspection also allows to 198 filter https responses. 199 - developer-manual: Mention that announce.txt should be updated 200 when doing a release. 201 - config: Explicitly mention that the CGI pages disclosing the 202 ca-password can be blocked and upgrade the disclosure paragraphs 203 to a warning. 204 - Put all the requested debug options in the config file. 205 Section 11.1 of the Privoxy user manual lists all the debug 206 options that should be enabled when reporting problems or requesting support. 207 Make it easier for users to do the right thing by having all those 208 options present in the config. 209 - Update TODO list item #184 to note that WolfSSL support will 210 (hopefully) appear after the 3.0.34 release. 211 - Update max-client-connections's description. 212 On modern systems other than Windows Privoxy should 213 use poll() in which case the FD_SETSIZE value isn't 214 releveant. 215 - Add a warning that the socket-timeout does not apply 216 to operations done by TLS libraries. 217 - Make documentation slightly less "offensive" for some people 218 by avoiding the word "hell". 219 220*** Version 3.0.32 stable *** 221 222- Security/Reliability: 223 - ssplit(): Remove an assertion that could be triggered with a 224 crafted CGI request. 225 Commit 2256d7b4d67. OVE-20210203-0001. CVE-2021-20272. 226 Reported by: Joshua Rogers (Opera) 227 - cgi_send_banner(): Overrule invalid image types. Prevents a 228 crash with a crafted CGI request if Privoxy is toggled off. 229 Commit e711c505c48. OVE-20210206-0001. CVE-2021-20273. 230 Reported by: Joshua Rogers (Opera) 231 - socks5_connect(): Don't try to send credentials when none are 232 configured. Fixes a crash due to a NULL-pointer dereference 233 when the socks server misbehaves. 234 Commit 85817cc55b9. OVE-20210207-0001. CVE-2021-20274. 235 Reported by: Joshua Rogers (Opera) 236 - chunked_body_is_complete(): Prevent an invalid read of size two. 237 Commit a912ba7bc9c. OVE-20210205-0001. CVE-2021-20275. 238 Reported by: Joshua Rogers (Opera) 239 - Obsolete pcre: Prevent invalid memory accesses with an invalid 240 pattern passed to pcre_compile(). Note that the obsolete pcre code 241 is scheduled to be removed before the 3.0.33 release. There has been 242 a warning since 2008 already. 243 Commit 28512e5b624. OVE-20210222-0001. CVE-2021-20276. 244 Reported by: Joshua Rogers (Opera) 245 246- Bug fixes: 247 - Properly parse the client-tag-lifetime directive. Previously it was 248 not accepted as an obsolete hash value was being used. 249 Reported by: Joshua Rogers (Opera) 250 - decompress_iob(): Prevent reading of uninitialized data. 251 Reported by: Joshua Rogers (Opera). 252 - decompress_iob(): Don't advance cur past eod when looking 253 for the end of the file name and comment. 254 - decompress_iob(): Cast value to unsigned char before shifting. 255 Prevents a left-shift of a negative value which is undefined behaviour. 256 Reported by: Joshua Rogers (Opera) 257 - gif_deanimate(): Confirm that that we have enough data before doing 258 any work. Fixes a crash when fuzzing with an empty document. 259 Reported by: Joshua Rogers (Opera). 260 - buf_copy(): Fail if there's no data to write or nothing to do. 261 Prevents undefined behaviour "applying zero offset to null pointer". 262 Reported by: Joshua Rogers (Opera) 263 - log_error(): Treat LOG_LEVEL_FATAL as fatal even when --stfu is 264 being used while fuzzing. 265 Reported by: Joshua Rogers (Opera). 266 - Respect DESTDIR when considering whether or not to install 267 config files with ".new" extension. 268 - OpenSSL ssl_store_cert(): Fix two error messages. 269 - Fix a couple of format specifiers. 270 - Silence compiler warnings when compiling with NDEBUG. 271 - fuzz_server_header(): Fix compiler warning. 272 - fuzz_client_header(): Fix compiler warning. 273 - cgi_send_user_manual(): Also reject requests if the user-manual 274 directive specifies a https:// URL. Previously Privoxy would try and 275 fail to open a local file. 276 277- General improvements: 278 - Log the TLS version and the the cipher when debug 2 is enabled. 279 - ssl_send_certificate_error(): Respect HEAD requests by not sending a body. 280 - ssl_send_certificate_error(): End the body with a single new line. 281 - serve(): Increase the chances that the host is logged when closing 282 a server socket. 283 - handle_established_connection(): Add parentheses to clarify an expression 284 Suggested by: David Binderman 285 - continue_https_chat(): Explicitly unset CSP_FLAG_CLIENT_CONNECTION_KEEP_ALIVE 286 if process_encrypted_request() fails. This makes it more obvious that the 287 connection will not be reused. Previously serve() relied on 288 CSP_FLAG_SERVER_CONTENT_LENGTH_SET and CSP_FLAG_CHUNKED being unset. 289 Inspired by a patch from Joshua Rogers (Opera). 290 - decompress_iob(): Add periods to a couple of log messages 291 - Terminate the body of the HTTP snipplets with a single new line 292 instead of "\r\n". 293 - configure: Add --with-assertions option and only enable assertions 294 when it is used 295 - windows build: Use --with-brotli and --with-mbedtls by default and 296 enable dynamic error checking. 297 - gif_deanimate(): Confirm we've got an image before trying to write it 298 Saves a pointless buf_copy() call. 299 - OpenSSL ssl_store_cert(): Remove a superfluous space before the serial number. 300 301- Action file improvements: 302 - Disable fast-redirects for .golem.de/ 303 - Unblock requests to adri*. 304 - Block requests for trc*.taboola.com/ 305 - Disable fast-redirects for .linkedin.com/ 306 307- Filter file improvements: 308 - Make the second pcrs job of the img-reorder filter greedy again. 309 The ungreedy version broke the img tags on: 310 https://bulk.fefe.de/scalability/. 311 312- Privoxy-Log-Parser: 313 - Highlight a few more messages. 314 - Clarify the --statistics output. The shown "Reused connections" 315 are server connections so name them appropriately. 316 - Bump version to 0.9.3. 317 318- Privoxy-Regression-Test: 319 - Add the --check-bad-ssl option to the --help output. 320 - Bump version to 0.7.3. 321 322- Documentation: 323 - Add pushing the created tag to the release steps in the developer manual. 324 - Clarify that 'debug 32768' should be used in addition to the other debug 325 directives when reporting problems. 326 - Add a 'Third-party licenses and copyrights' section to the user manual. 327 328*** Version 3.0.31 stable *** 329 330- Security/Reliability: 331 - Prevent an assertion from getting triggered by a crafted CGI request. 332 Commit 5bba5b89193fa. OVE-20210130-0001. CVE-2021-20217. 333 Reported by: Joshua Rogers (Opera) 334 - Fixed a memory leak when decompression fails "unexpectedly". 335 Commit f431d61740cc0. OVE-20210128-0001. CVE-2021-20216. 336 337- Bug fixes: 338 - Fixed detection of insufficient data for decompression. 339 Previously Privoxy could try to decompress a partly 340 uninitialized buffer. 341 342*** Version 3.0.30 stable *** 343 344- Bug fixes: 345 - Check the actual URL for redirects when https inspecting requests. 346 Previously Privoxy would only check the path which resulted in 347 rewrite results being rejected as invalid URLs. 348 Reported by withoutname in #1736. 349 - Let the hide-referrer code tolerate Referer headers with https:// URLs. 350 Previously they would always be treated like a changed host. 351 - Use the https headers if the show-request handler is reached through 352 https://. Previously Privoxy would use the http headers which 353 may be empty on a reused connection. 354 - Make CGI_PREFIX protocol-relative when building with FEATURE_HTTPS_INSPECTION. 355 This unbreaks (at least) https://config.privoxy.org/client-tags whose 356 buttons would previously use a http:// URL resulting in browser warnings. 357 - Support using https-inspection and client-header-order at the same time. 358 Previously Privoxy would crash. 359 Reported by: Kai Raven 360 - Properly reject rewrites from http to https as they currently 361 aren't supported. Previously Privoxy would wait for the client 362 to establish an encrypted connection which obviously would not happen. 363 - When https inspection is enabled and Privoxy has been compiled with 364 FEATURE_GRACEFUL_TERMINATION (not recommended for production builds), 365 the TLS backend resources are free'd later on and only if no active 366 connections are left. Prevents crashes when exiting "gracefully" at the 367 wrong time. 368 - Let the uninstall target remove the config file even if DESTDIR 369 is set and properly announce the deletion of the configuration files. 370 371- General improvements: 372 - Allow to rewrite the request destination for https-inspected 373 requests behind the client's back. The documentation already sort 374 of claimed that it was supported by not especially mentioning that 375 it didn't work for https-inspected requests. 376 Fixes SF bug #923 reported by withoutname. 377 - Add support for filtering client request bodies by using 378 CLIENT-BODY-FILTER filters which can be enabled with the 379 client-body-filter action. 380 Patch submitted by Maxim Antonov. 381 Sponsored by: Robert Klemme 382 - Add the new action suppress-tag{} which can be used to prevent 383 a tagger from adding a tag. Patch submitted by Maxim Antonov. 384 Sponsored by: Robert Klemme 385 - Gracefully handle existing website keys without matching certificates. 386 This can happen if Privoxy was previously running with an invalid 387 TLS configuration that didn't allow it to create a certificate. 388 - Recycle debug bit 4 for Tagging-related messages. 389 - Improve the message shown when the client-tags CGI page 390 is requested with no tags configured. 391 - Shorten the 'donate' and 'participate' links used by templates 392 using redirects. Currently the redirects lead to the FAQ entries 393 but in the future we may want to relocate the content and using 394 redirects makes this more convenient. 395 - Log an error when a PCRE-HOST-PATTERN is used with 396 FEATURE_PCRE_HOST_PATTERNS disabled. Don't treat this a 397 fatal error so the regression tests can be used with and 398 without FEATURE_PCRE_HOST_PATTERNS. 399 - The code compiles with older C compilers again. 400 - The chdir() return code is checked to fix a compiler warning. 401 - The packages feed has been removed from the source tarball. 402 It's usually out of date when the source tarball is generated 403 for the release. 404 - Fixed harmless compiler warnings from GCC9 with -D_FORTIFY_SOURCE=2. 405 - windows: Remove obsolete '$(DEST)/doc/images' target. 406 - windows: Install the images referenced in the user manual. 407 - Remove obsolete 'gnu_regex.@OBJEXT@' target. 408 - When installing from the GNUMAkefile, don't create an 'images' 409 directory which is no longer used. The images were relocated to 410 the user-manual directory years ago. 411 - Add new FEATURES to the show-status page and resort list. 412 - Remove unused variable in the OpenSSL-specific code. 413 - Update bug tracker URL in cgi_error_unknown(). 414 - Saved a couple of memory allocations when sorting client headers. 415 - Improved a couple of error messages. 416 - Saved memory allocations when using OpenSSL and checking if a 417 key already exists. 418 - The configure script will bail out if OpenSSL and mbedTLS are 419 enabled at the same time. 420 - Log a message right before exiting gracefully. 421 - A couple of structures have been rearranged to require slightly 422 less memory. 423 - When https inspection is enabled and the certificate is invalid 424 the error message is now sent with status code 403 instead of 200. 425 - The Slackware rc script template has been renamed to 426 slackware/rc.privoxy.in to silence complaints when building 427 Debian packages. 428 - When building with MbedTLS support, mbedtls_md5_ret() is used 429 instead of mbedtls_md5() which is deprecated and causes a warning 430 on Debian GNU/Linux. 431 432- Action file improvements: 433 - Block requests to eu-tlp03.kameleoon.com/. 434 - Unblock metrics.sr.ht/. 435 - Disable fast-redirects for .fsf.org/. 436 - Disable fast-redirects for .gravater.com/. 437 - Disable fast-redirects for .ksta.de/. 438 - Block requests to tag.crsspxl.com/. 439 - Block requests to analytics.slashdotmedia.com/. 440 - Block requests to ml314.com/. 441 - Block requests to .adroll.com/. 442 - Block requests to fastlane.rubiconproject.com/. 443 - Block requests to api.theadex.com/. 444 - Block requests to ih.adscale.de/. 445 - Block requests to .s400.meetrics.net/. 446 - Block requests for pp.lp4.io/. 447 - Block requests for trc-events.taboola.com/. 448 449- Filter file improvements: 450 - A allow-autocompletion filter has been added which changes 451 autocomplete="off" to "on" on input fields to allow autocompletion. 452 Requested by Jamie Zawinski in #370. 453 Filter based on a submission by Aaron Linville. 454 - Added an imdb filter. 455 - Added a sourceforge filter that reduces the amount of ads 456 for proprietary software. 457 - Added a github filter that removes the annoying "Sign-Up" 458 banner and the Cookie disclaimer. 459 - Removed a duplicated pcrs command from the js-annoyances filter. 460 - The crude-parental filter now provides a short reason when blocking, 461 inserts a link to Privoxy's webinterface and adds a new line at 462 the end of the generated page. 463 464- Privoxy-Log-Parser: 465 - Highlight a few more messages. 466 - Add a handler for tagging messages. 467 - Properly deal with 'Certificate error' crunches 468 Previously the error description was highlighted as 'host'. 469 - Log truncated LOG_LEVEL_CLF messages more gracefully 470 and note that the statistics will be imprecise. 471 - Fixed perldoc typo. 472 - Bump version to 0.9.2. 473 474- Privoxy-Regression-Test: 475 - Use http://127.0.0.1:8118/ as default Privoxy address 476 unless http_proxy is set through the environment. 477 - Add a --privoxy-cgi-prefix option that specifies the prefix 478 to use when building URLs that are supposed to reach Privoxy's 479 CGI interface. If it's not set, http://p.p/ is used, which is 480 supposed to work with the default Privoxy configuration. 481 If Privoxy has been built with FEATURE_HTTPS_INSPECTION enabled, 482 and if https inspection is activated with the +https-inspection 483 action, this option can be used with "https://p.p/" provided the 484 system running Privoxy-Regression-Test has been configured to 485 trust the certificate used by Privoxy. 486 Note that there are currently two tests in the official 487 regression-tests.action file that are expected to fail 488 when using "https://p.p/" as privoxy-cgi-prefix. 489 - Skip the connection-established response in get_status_code() 490 when looking for the status code with a CGI prefix 491 that starts with https://. We care about the status code 492 sent by the impersonated web server. 493 - Use --proxy-header when using a CGI prefix with https:// 494 and a "Host:" header. 495 - Allow '|' in tokens and values to allow tag patterns like 496 "TAG:^(application|text)/(x-)?javascript$". 497 - When get_cgi_page_or_else() fails, include the URL of the 498 requested page in the log message. 499 - Added a --check-bad-ssl option that can be used to verify that 500 Privoxy detects certificate problems when accessing the test 501 sites from badssl.com. 502 - Bumped version to 0.7.2 503 504- uagen: 505 - Update example output. 506 - Recommend the use of the https-inspection action in the documentation. 507 - Upgrade a couple of URLs to https://. 508 - Add ElectroBSD to the list of operating systems. 509 - Bumped generated Firefox version to 78 (ESR). 510 - Bumped version to 1.2.2. 511 512 - User documentation: 513 - Remove reference to 'How to Report Bugs Effectively'. 514 It was only rendered as text without URL in the README anyway 515 and there's no indication that users read it ... 516 - Let the dok-readme target fix the location embedded into the 517 README file. This used to be done by CVS but since the git migration 518 it has to be done through other means. 519 - Remove 'experimental' warning for client-specific-tag-related directives. 520 They seem to work reliably and there is no obvious reason 521 why we would change the syntax in the near future. 522 - Describe how to check if Privoxy has been built with 523 FEATURE_HTTPS_INSPECTION. 524 - Add a link to the trusted-cas-file documentation 525 that explains how the user can create the file herself. 526 - Don't explicitly mention the license for the code coming from 527 'Anonymous Coders' and Junkbusters. It's obviously licensed under 528 the GNU GPL like the rest of Privoxy or we wouldn't be allowed to 529 distribute it. 530 - Update the +hide-user-agent example with uagen output. 531 - Slightly improve the wording of the ca-key-file documentation. 532 - Explicitly mention Windows 10 as supported so search engines and 533 users looking for it can find it. 534 - Import a bunch of contributors from the ChangeLog. 535 - Remove obsolete doc/gpl.html. 536 - Upgrade a couple of links to https://. 537 - Don't prefer the SourceForge patch tracker over the 538 privoxy-devel mailing list. While at it, link to the 539 SourceForge patch tracker. 540 - Mention http-inspection in the 'my browser warns me about 541 unauthenticated content' FAQ entry. 542 - Simplify the 'Is there is a license or fee?' FAQ entry. 543 - Add another +redirect{} example. 544 - Explicitly mention that interested sponsors should include 545 the link target in their first mail. 546 - Clarify that only Privoxy team members can object to new sponsors 547 and link to the list of current team members. 548 - Note that sponsor URLs may not contain keyword spam. 549 - Garbage collect doc/webserver/images which isn't referenced anymore. 550 - Update the method to reach the proxy settings in Firefox. 551 - Update proxy_setup.jpg description to refer to Firefox. 552 - Regenerate proxy_setup.jpg with a more recent Firefox (78.0). 553 - Regenerate files-in-use.jpg without obsolete standard.action 554 with modern colors and a slightly better quality. 555 - Update URL to the actionsfile tracker. 556 - Update a support request URL. 557 - Rephrase the 'Can Privoxy run as service' FAQ entry and 558 remove an obsolete paragraph. 559 - Let the 'Where can I get updated Actions Files?' entry link to 560 the gitweb version of default.action.master. 561 - Update a link to the default.action file. 562 - Update URLs for trackers and mailing lists. 563 - Replace CVS reference with git. 564 - Mention regression-tests.action in the config file. 565 - Explicitly mention in the config file that access to the 566 CA key should be limited to Privoxy. 567 - List more client-specific-tag examples for inspiration. 568 - Add additional headers to the client-header-order example. 569 - Note that actions aren't updated after rewrites. 570 - Explicitly mention that upgrading from http to https with 571 a client-header filter is not supported 572 - Note that protocol and host have to be added when rewriting 573 the destination host for https-inspected requests. 574 - Explicitly mention that the CA key is used to sign certificates. 575 - Put openssl command in 'command' tags. 576 - The man page has been moved from section 1 to man section 8. 577 578- Developer manual: 579 - Flesh out the build instructions for Debian. 580 - Remove the packaging instructions for RPM-based systems. 581 They don't work and we don't release RPM packages anymore anyway. 582 - Remove the packaging instructions for Solaris. 583 They don't work and we don't release Solaris packages anymore anyway. 584 - Update the suggested subject for the announce mails. 585 - Update upload instructions. 586 ftp://upload.sourceforge.net is no longer functional. 587 - Remove a couple of package-dependent upload instructions 588 that don't actually work. 589 - Remove 'cd current' that no longer works. 590 - Add regression-tests.action to the list of files that should be installed. 591 - Stop claiming that there are text versions of the manuals. 592 We stopped building them in 2008 (9ed36a3c5e6f12). 593 - Note that the 'webserver' target creates the link needed for the user-manual. 594 - Suggest to use the master branch as reference when creating 595 the ChangeLog so the steps work when the current branch differs 596 from master which is likely as the developer manual 597 suggests to use a local branch for development. 598 - Add the -s flag to the suggested 'git tag' command. We prefer signed tags. 599 - Mention that merges into 'master' should be avoided. 600 - Add git commands that should result in a merge-free history. 601 - Mention Privoxy-Regression-Test. 602 - Add a section id to reduce link churn. 603 - Recommend the dok-tidy target when building docs for the webserver. 604 - Add another plug for the privoxy-devel mailing list. 605 - Let the intro link the copyright section in the user manual instead 606 of giving an incomplete summary of the license status. 607 - Clarify that the webserver target uploads to the SourceForge webserver. 608 - Mark the documentation for the Mac OS X installers as out of date and 609 change the SCM name back to CVS. 610 - Fix the location of the installer modules for Mac OS X. 611 They are not actually available through git (yet). 612 - Don't speak of Privoxy version 3 in the past tense. 613 - Update the list of programs required for the release process. 614 - Update description of the webserver target which uses ssh, not scp. 615 - Remove obsolete reference to config.new. 616 617- Tests: 618 - Add another hide-referrer{conditional-block} test. 619 - Add another hide-referrer{conditional-forge} test. 620 - Fix a hide-referrer{conditional-forge} test 621 that expected an acceptable header to be forged. 622 - Fix a hide-referrer{conditional-block} test 623 that expected an acceptable Referer to be removed. 624 - Explain why the "Set Header = Host: whatever.example.org" test is 625 expected to fail when using a CGI prefix that starts with "https://". 626 - Explain why a connection-sharing test is known to fail 627 when using "https://p.p/" as CGI prefix. 628 - Add a link to Privoxy-Regression-Test to regression-tests.action 629 in case it isn't packaged. 630 - Add regression tests for pcre host patterns. 631 - Fixed a regression test that is executed when 632 FEATURE_GRACEFUL_TERMINATION is enabled. 633 634- Privoxy infrastructure: 635 - Import a Privoxy logo for the website. 636 - Update Tor onion service to HiddenServiceVersion 3. 637 - Display the "model" photos in a single row and remove placeholder images. 638 - Regenerate homepage with updated sponsor list. 639 - Use the '/sponsor' redirect for the link to the sponsor page. 640 - Git commit messages are sent to the Privoxy-commits mailing list. 641 642*** Version 3.0.29 stable *** 643 644- Security/Reliability: 645 - Fixed memory leaks when a response is buffered and the buffer 646 limit is reached or Privoxy is running out of memory. 647 Commits bbd53f1010b and 4490d451f9b. OVE-20201118-0001. 648 CVE-2020-35502. 649 Sponsored by: Robert Klemme 650 - Fixed a memory leak in the show-status CGI handler when 651 no action files are configured. Commit c62254a686. 652 OVE-20201118-0002. CVE-2021-20209. 653 Sponsored by: Robert Klemme 654 - Fixed a memory leak in the show-status CGI handler when 655 no filter files are configured. Commit 1b1370f7a8a. 656 OVE-20201118-0003. CVE-2021-20210. 657 Sponsored by: Robert Klemme 658 - Fixes a memory leak when client tags are active. 659 Commit 245e1cf32. OVE-20201118-0004. CVE-2021-20211. 660 Sponsored by: Robert Klemme 661 - Fixed a memory leak if multiple filters are executed 662 and the last one is skipped due to a pcre error. 663 Commit 5cfb7bc8fe. OVE-20201118-0005. CVE-2021-20212. 664 - Prevent an unlikely dereference of a NULL-pointer that 665 could result in a crash if accept-intercepted-requests 666 was enabled, Privoxy failed to get the request destination 667 from the Host header and a memory allocation failed. 668 Commit 7530132349. CID 267165. OVE-20201118-0006. CVE-2021-20213. 669 - Fixed memory leaks in the client-tags CGI handler when 670 client tags are configured and memory allocations fail. 671 Commit cf5640eb2a. CID 267168. OVE-20201118-0007. CVE-2021-20214. 672 - Fixed memory leaks in the show-status CGI handler when memory 673 allocations fail. Commit 064eac5fd0 and commit fdee85c0bf3. 674 CID 305233. OVE-20201118-0008. CVE-2021-20215. 675 676- General improvements: 677 - Added experimental https inspection support which allows to filter 678 https traffic. To enable it, install MbedTLS and configure with 679 --with-mbedtls, or install OpenSSL or LibreSSL and configure 680 with --with-openssl. 681 Afterwards configure the directives in section 7 of the 682 config file and enable the +https-inspection action. 683 Initial MbedTLS-based code contributed by Vaclav Svec, 684 initial OpenSSL support contributed by Maxim Antonov. 685 With help from Nedzad Hrnjica and Ho+ Ho+ Ho+. 686 Integration and improvements sponsored by Robert Klemme. 687 - pcrs: Request JIT compilation if it's supported and 688 the filter isn't dynamic. This can speed up filtering. 689 - Added support for Brotli decompression. 690 Sponsored by: Robert Klemme 691 - Added FEATURE_EXTENDED_STATISTICS to gather statistics for 692 block reasons and filter executions. To enable it, configure 693 with --enable-extended-statistics and visit 694 http://config.privoxy.org/show-status. 695 Sponsored by: Robert Klemme 696 - Use the IP_FREEBIND socket option, if defined. This allows 697 Privoxy to bind to not-yet assigned IP addresses which is 698 useful in failover environments. 699 Patch by Sam Varshavchik. 700 - Allow to use extended host patterns and vanilla host patterns 701 at the same time by prefixing extended host patterns with 702 "PCRE-HOST-PATTERN:". To enable this, configure with 703 --enable-pcre-host-patterns. 704 Sponsored by: Robert Klemme 705 - Added "Cross-origin resource sharing" (CORS) support. 706 This allows to access Privoxy's CGI interface via JavaScript from 707 another domain (white-listed with the new cors-allowed-origin directive). 708 Based on a patch by Nedzad Hrnjica. 709 Sponsored by: Robert Klemme. 710 - Add SOCKS5 username/password support. 711 Based on a patch by Sam, improved by Ivan Romanov. 712 Closes Patch#141 and solves TODO#105. 713 - Bump the maximum number of action and filter files 714 to 100 each. 715 Sponsored by: Robert Klemme 716 - Fixed handling of filters with "split-large-forms 1" 717 when using the CGI editor. 718 Reported by withoutname in #921. 719 - Better detect a mismatch of connection details when 720 figuring out whether or not a connection can be reused. 721 - Don't send a "Connection failure" message instead of the 722 "DNS failure" message. 723 Sponsored by: Robert Klemme 724 - Let LOG_LEVEL_REQUEST log all requests. Previously unencrypted 725 requests were only logged with LOG_LEVEL_REQUEST when they weren't 726 crunched (in which case they were logged with LOG_LEVEL_CRUNCH). 727 This was documented behaviour, but logging all requests seems more useful. 728 - Fixed locking around localtime() and gmtime(). 729 - Removed OS/2 support. We haven't provided OS/2 packages in years, 730 it complicated the code and it depended on a fallback snprintf() 731 implementation which is GPLv2 only. 732 - Remove the fallback snprintf() implementation 733 Now that OS/2 support is gone we no longer need it. 734 - Fixed a bunch of format specifiers log messages. 735 - Added a missing apostrophe in the 'More Privoxy' menu. 736 - Explicitly prevent use of FEATURE_CONNECTION_SHARING 737 without FEATURE_CONNECTION_KEEP_ALIVE. It makes no sense 738 and does not compile anyway. 739 Sponsored by: Robert Klemme 740 - Fix build without FEATURE_CONNECTION_KEEP_ALIVE. 741 Sponsored by: Robert Klemme 742 - Downgrade the 'Graceful termination requested' message 743 to LOG_LEVEL_INFO as it isn't an error. 744 Sponsored by: Robert Klemme 745 - decompress_iob(): Downgrade the no-content message to LOG_LEVEL_RE_FILTER 746 While at it, fix a typo in a comment. 747 Sponsored by: Robert Klemme 748 - Fixed a couple of cppcheck warnings. 749 - Rename LOG_LEVEL_GPC to LOG_LEVEL_REQUEST. 750 Only the shadow knows what "GPC" is supposed to stand for. 751 - Remove SourceForge references in copyright headers. 752 - Upgrade a bunch of links to the homepage to https://. 753 - Add 'no-brotli-accepted' filter which prevents the 754 use of Brotli compression. 755 - Changed license for pcrs to GPLv2+ after getting the 756 permission from Andreas. This allows to redistribute 757 Privoxy under the GPLv3 which is required when linking 758 to future mbedTLS versions which are expected to be 759 licensed under the Apache 2.0 license only. 760 - Updated a bunch of tests that have to expect status code 403 761 now after r1.168/070e904afa5. 762 - Lowercase the host name in the request line. 763 - Only set SOURCE_DATE_EPOCH if it's not already set so 764 distributions can overwrite it through the environment. 765 766- Documentation changes: 767 - Explain that Privoxy has to be distributed under the 768 GPLv3 (or later) when linked with an MbedTLS version 769 that is licensed under the Apache 2.0 license. 770 - Import the GNU GPLv3 and include it the user manual. 771 - Clarify FEATURE_FORCE_LOAD's description. It allows to bypass 772 blocking not filtering and only does it if blocks aren't enforced. 773 Reported by: Robert Klemme 774 - FAQ: Remove Zwiebelfreunde e.V. from the list of fiduciary sponsors 775 As of 2021 they no longer handle donations for foreign organisations 776 due to lack of resources. 777 - FAQ: Remove an obsolete comment with a link to the long-gone PDF manual. 778 - FAQ: Add a link to the TODO list. 779 - FAQ: Change the sponsor amounts to USD slightly rounding the 780 converted amounts up to get simple numbers. 781 Receiving USD is apparently easier for SPI and SPI is 782 preferred by sponsors as they can send invoices. 783 - Advertise the client-tags CGI page in the user manual. 784 - Stop advertising the show-version CGI page which no longer exists. 785 - Add yet another reason why +prevent-compression may cause problems. 786 - Don't claim that contributors need ssh. It's only needed for committers. 787 - Replace obsolete CVS instructions with Git instructions. 788 - Remove an obsolete comment 789 790- Config file changes: 791 - Change the suggested default-server-timeout to 5 to match the 792 suggested keep-alive-timeout. Otherwise using the defaults would 793 result in Privoxy reducing the default-server-timeout and logging 794 an error message. 795 Sponsored by: Robert Klemme 796 - Update the 'debug 1' description. 797 - Add a missing 'client-specific-tag' directive. 798 - Comment out trusted-cgi-referer pointing to example.org. 799 800- Action file improvements: 801 - Block requests to /(.*/)?piwik\.php 802 - Block requests to .connectaserver.de/ 803 - Block requests to pixel.inforsea.com/ 804 - Block requests to t.vi-serve.com/ 805 - Block requests to .ioam.de/ 806 - Block requests to t.9gag.com/img.gif 807 - Block requests to .pixel.parsely.com/ as image 808 - Block requests to pixel.wp.com/ 809 - Disable fast-redirects for .librarything.com/ 810 - Disable fast-redirects for issue.freebsdfoundation.org/ 811 - Disable fast-redirects for .twitter.com/.*origin=http 812 - Unblock belco24.de/ 813 - Add fast-redirects exception for .wikipedia.org/ 814 - Add fast-redirects exception for oss-fuzz.com/ 815 - Disable fast-redirects for .consensu.org/delivery/pixel\.php 816 and block the requests as image instead 817 - Unblock .adbinstaller.com/ 818 Reported by lvm in #942. 819 - Unblock .adbshell.com 820 Reported by lvm in #942. 821 - Unblock .tagesschau.de/ 822 - Disable fast-redirects for collector.githubapp.com/ 823 and block requests to it as image instead 824 - Unblock 'ada*.' 825 - Add fast-redirects{} exception for sourcepoint.vice.com/ 826 - Unblock adaway.org/ 827 Reported by DRS David Soft in AF#945. 828 - Change two block reasons that previously were the same. 829 Sponsored by: Robert Klemme 830 - Added a +delay-response{} test. 831 - Updated the location of the development version 832 of default.action.master. 833 834- Privoxy-Log-Parser: 835 - Added a --keep-date option to keep the date in highlighted messages. 836 - Highlight new log messages. 837 - Make gather_loglevel_clf_stats() more tolerant. While at it, 838 count all CLF messages as requests, even if the request is invalid. 839 - Only show HTTP version distribution if at least one version has been detected. 840 - Only show crunch statistics if crunches were detected. 841 - Warn if the request counts differ. 842 - Generate statistics if the log only contains LOG_LEVEL_CLF messages 843 so it can be used with vanilla webserver logs. 844 Previously Privoxy-specific "Request:" messages were required. 845 - Align the client-HTTP-version distribution like other distributions 846 - Bump version to 0.9.1 847 - Include status code distribution in the stats. 848 - Let the statistics include the size of the content Privoxy 849 transferred excluding HTTP headers. 850 - Get with the program and expect all requests to be logged with LOG_LEVEL_REQUEST. 851 It's no longer necessary to count both LOG_LEVEL_REQUEST and 852 LOG_LEVEL_CRUNCH messages to get the total number of requests. 853 - Leverage the LOG_LEVEL_CLF message to gather statistics that where 854 previously taken from LOG_LEVEL_HEADER lines. This results in less 855 confusing results if https inspection is enabled in which case there 856 are two LOG_LEVEL_HEADER lines with request lines. 857 Sponsored by: Robert Klemme 858 - Properly highlight the filter results message. Previously a brace got lost. 859 - Prefer the number of CLF lines to get the total number of requests 860 as it works with older Privoxy versions as well. 861 862- Privoxy-Regression-Test: 863 - Turn curl's globbing mode off so we can allow more characters in URLs. 864 - Allow '[' and ']' in URLs. 865 - Include the action file when complaining about missing Sticky Actions. 866 - Fix a sentence in the documentation. 867 - Bump version to 0.7.1 868 869- url-pattern-translator: 870 - Detect a couple of pattern prefixes case-insensitively. 871 Sponsored by: Robert Klemme 872 - Skip CLIENT-TAG patterns. 873 Sponsored by: Robert Klemme 874 - Skip patterns that have already been converted. 875 It should now be safe to "convert" a file multiple times. 876 Sponsored by: Robert Klemme 877 - Add the new 'PCRE-HOST-PATTERN:' prefix. 878 Sponsored by: Robert Klemme 879 880*** Version 3.0.28 stable *** 881 882- Bug fixes for regressions in 3.0.27: 883 - Fixed misplaced parentheses. 884 Reported by David Binderman. 885 - Changed two regression tests to depend on config directive 886 enable-remote-toggle instead of FEATURE_TOGGLE. 887 888*** Version 3.0.27 stable *** 889 890- General improvements: 891 - Add a receive-buffer-size directive which can be used to 892 set the size of the previously statically allocated buffer 893 in handle_established_connection(). 894 Increasing the buffer size increases Privoxy's memory usage but 895 can lower the number of context switches and thereby reduce the 896 CPU usage and potentially increase the throughput. 897 This is mostly relevant for fast network connections and 898 large downloads that don't require filtering. 899 Sponsored by: Robert Klemme 900 - Add a listen-backlog directive which specifies the backlog 901 value passed to listen(). 902 Sponsored by: Robert Klemme 903 - Add an enable-accept-filter directive which allows to 904 toggle accept filter support at run time when compiled 905 with FEATURE_ACCEPT_FILTER support. 906 It makes testing more convenient and now that it's 907 optional we can emit an error message if enabling 908 the accept filter fails. 909 Sponsored by: Robert Klemme 910 - Add a delay-response{} action. 911 This is useful to tar pit JavaScript requests that 912 are endlessly retried in case of blocks. It can also 913 be used to simulate a slow Internet connection. 914 Sponsored by: Robert Klemme 915 - Add a 'trusted-cgi-referrer' directive. 916 It allows to configure another page or site that can be used 917 to reach sensitive CGI resources. 918 Sponsored by: Robert Klemme 919 - Add a --fuzz mode which exposes Privoxy internals to input 920 from files or stdout. 921 Mainly tested with American Fuzzy Lop. For details see: 922 https://www.fabiankeil.de/talks/fuzzing-on-freebsd/ 923 This work was partially funded with donations and done 924 as part of the Privoxy month in 2015. 925 - Consistently use the U(ngreedy) flag in the 'img-reorder' filter. 926 - listen_loop(): Reuse a single thread attribute object 927 The object doesn't change and creating a new one for 928 every thread is a waste of (CPU) time. 929 Sponsored by: Robert Klemme 930 - Free csp resources in the thread that belongs to the csp instead 931 of the main thread which has enough on its plate already. 932 Sponsored by: Robert Klemme 933 - Improve 'socket timeout reached' message. 934 Log the timeout that was triggered and downgrade the 935 log level to LOG_LEVEL_CONNECT to reduce the log noise 936 with common debug settings. 937 The timeout isn't necessary the result of an error and 938 usually merely indicates that Privoxy's socket timeout 939 is lower than the relevant timeouts used by client and 940 server. 941 Sponsored by: Robert Klemme 942 - Explicitly taint the server socket in case of CONNECT requests. 943 This doesn't fix any known problems, but makes 944 some log messages less confusing. 945 - Let write_pid_file() terminate if the pid file can't be opened. 946 Logging the issue at info level is unlikely to help. 947 - log_error(): Reduce the mutex-protected area by not using a 948 heap-allocated buffer that is shared between all threads. 949 This increases performance and reduces the latency with 950 verbose debug settings and multiple concurrent connections. 951 Sponsored by: Robert Klemme 952 - Let zalloc() use calloc() if it's available. 953 In some situations using calloc() can be faster than 954 malloc() + memset() and it should never be slower. 955 In the real world the impact of this change is not 956 expected to be noticeable. 957 Sponsored by: Robert Klemme 958 - Never use select() when poll() is available. 959 On most platforms select() is limited by FD_SETSIZE while 960 poll() is not. This was a scaling issue for multi-user setups. 961 Using poll() has no downside other than the usual risk 962 that code modifications may introduce new bugs that have 963 yet to be found and fixed. 964 At least in theory this commit could also reduce the latency 965 when there are lots of connections and select() would use 966 "bit fields in arrays of integers" to store file descriptors. 967 Another side effect is that Privoxy no longer has to stop 968 monitoring the client sockets when pipelined requests are 969 waiting but can't be read yet. 970 This code keeps the select()-based code behind ifdefs for 971 now but hopefully it can be removed soonish to make the 972 code more readable. 973 Sponsored by: Robert Klemme 974 - Add a 'reproducible-tarball-dist' target. 975 It's currently separate from the "tarball-dist" target 976 because it requires a tar implementation with mtree spec 977 support. 978 It's far from being perfect and does not enforce a 979 reproducible mode, but it's better than nothing. 980 - Use arc4random() if it's available. 981 While Privoxy doesn't need high quality pseudo-random numbers 982 there's no reason not to use them when we can and this silences 983 a warning emitted by code checkers that can't tell whether or not 984 the quality matters. 985 - Show the FEATURE_EXTERNAL_FILTERS status on the status page. 986 Better late than never. Previously a couple of tests weren't 987 executed as Privoxy-Regression-Test couldn't detect that the 988 FEATURE_EXTERNAL_FILTERS dependency was satisfied. 989 - Ditch FEATURE_IMAGE_DETECT_MSIE. 990 It's an obsolete workaround we inherited from Junkbuster 991 and was already disabled by default. 992 Users that feel the urge to work around issues with 993 image requests coming from an Internet Explorer version 994 from more than 15 years ago can still do this using tags. 995 - Consistently use strdup_or_die() instead of strdup() in 996 cases where allocation failures aren't expected. 997 Using strdup_or_die() allows to remove a couple of explicit 998 error checks which slightly reduces the size of the binary. 999 - Insert a refresh tag into the /client-tags CGI page when 1000 serving it while a client-specific tag is temporarily enabled. 1001 This makes it less likely that the user ends up 1002 looking at tag state that is out of date. 1003 - Use absolute URLs in the client-tag forms. 1004 It's more consistent with the rest of the CGI page 1005 URLs and makes it more convenient to copy the forms 1006 to external pages. 1007 - cgi_error_disabled(): Use status code 403 and an appropriate response line 1008 - Use a dedicated CGI handler to deal with tag-toggle requests 1009 As a result the /client-tags page is now safe to reach without 1010 trusted Referer header which makes bookmarking or linking to 1011 it more convenient. 1012 Finally, refreshing the /client-tags page to show the 1013 current state can no longer unintentionally repeat the 1014 previous toggle request. 1015 - Don't add a "Connection" header for CONNECT requests. 1016 Explicitly sending "Connection: close" is not necessary and 1017 apparently it causes problems with some forwarding proxies 1018 that will close the connection prematurely. 1019 Reported by Marc Thomas. 1020 - Fix compiler warnings. 1021 1022- Bug fixes: 1023 - rfc2553_connect_to(): Properly detect and log when poll() 1024 reached the time out. Previously this was logged as: 1025 Could not connect to [...]: No error: 0. 1026 which isn't very helpful. 1027 Sponsored by: Robert Klemme 1028 - add_tag_for_client(): Set time_to_live properly. 1029 Previously the time_to_live was always set for the first tag. 1030 Attempts to temporarily enable a tag would result in enabling 1031 it permanently unless no tag was enabled already. 1032 - Revert r1.165 which didn't perform as advertised. 1033 While the idea was to use "https:// when creating links 1034 for the user manual on the website", the actual effect 1035 was to use "https://" when Privoxy was supposed to serve 1036 the user manual itself. 1037 Reported by Yossi Zahn on Privoxy-devel@. 1038 - socks5_connect(): Fail in case of unsupported address types. 1039 Previously they would not be detected right away and 1040 Privoxy would fail later on with an error message that 1041 didn't make it obvious that the problem was socks-related. 1042 So far, no such problems have actually been reported. 1043 - socks5_connect(): Properly deal with socks replies that 1044 contain IPv6 addresses. 1045 Previously parts of the reply were left unread and 1046 later on treated as invalid HTTP response data. 1047 Fixes #904 reported by Danny Goossen who also provided 1048 the initial version of this patch. 1049 1050- Action file improvements: 1051 - Unblock 'msdn.microsoft.com/'. 1052 It (presumably) isn't used to serve the kind of ads Privoxy should 1053 block by default but happens to serve lots of pages with URLs that 1054 are likely to result in false positives. 1055 Reported by bugreporter1694 in AF#939. 1056 - Disable gif deanimation for requests tagged with CSS-REQUEST. 1057 The action will ignore content that isn't considered text 1058 anyway and explicitly disabling it makes this more obvious 1059 if "action" debugging (debug 65536) is enabled while 1060 "gif deanimation" debugging (debug 256) isn't. 1061 - Explicitly disable HTML filters for requests with CSS-REQUEST tag. 1062 The filters are unlikely to break CSS files but executing 1063 them without (intentionally) getting any hits is a waste of 1064 cpu time and makes the log more noisy when running with 1065 "debug 64". 1066 - Unblock 'adventofcode.com/'. 1067 Reported by Clint Adams in Debian bug #848211. 1068 Fixes Roland's AF#937. 1069 - Unblock 'adlibris.com'. 1070 Reported by Wyrex in #935 1071 - Unblock .golang.org/ 1072 - Add fast-redirects exception for '.youtube.com/.*origin=http' 1073 1074- Privoxy-Log-Parser: 1075 - Don't gather host and resource statistics if they aren't requested. 1076 While the performance impact seems negligible this significantly 1077 reduces the memory usage if there are lots of requests. 1078 - Bump version as the behaviour (slightly) changed. 1079 - Count connection failures as well in statistics mode. 1080 Sponsored by: Robert Klemme 1081 - Count connection timeouts as well in statistics mode. 1082 Sponsored by: Robert Klemme 1083 - Fix an 'uninitialized value' warning when generating 1084 statistics for a log file without response headers. 1085 While privoxy-log-parser was supposed to detect this already, 1086 the check was flawed and the message the user didn't see was 1087 somewhat confusing anyway. 1088 Now the message is less confusing, more helpful and actually printed. 1089 Reported by: Robert Klemme 1090 1091- Documentation improvements: 1092 - Refer to the git sources instead of CVS. 1093 - Use GNU/Linux when referring to the OS instead of the kernel. 1094 - Add FAQ entry for what to do if editing the config file is access denied. 1095 - Add brief HTTP/2 FAQ. 1096 - Add a small fuzzing section to the developer documentation. 1097 - Add a client-header-tagger{client-ip-address} example. 1098 - Stop suggesting that Privoxy is an anonymizing proxy. 1099 The term could lead to Privoxy users overestimating 1100 what it can do on its own (without Tor). 1101 - Make it more obvious that SPI accepts Paypal, too. 1102 Currently most donations are made through the Paypal account 1103 managed by Zwiebelfreunde e.V. and a more even distribution 1104 would be useful. 1105 - Suggest to log applying actions as well when reproducing problems. 1106 - Explicitly mention that Privoxy binaries are built by individuals 1107 on their own systems. Buyer beware! 1108 - Mention the release feed on the homepage. 1109 - Remove a mysterious comment with a GNU FDL link as it isn't 1110 useful and could confuse license scanners. 1111 In May 2002 it was briefly claimed that "this document" was covered 1112 by the GNU FDL. The commit message (r1.5) doesn't explain the motivation 1113 or whether all copyright holders were actually asked and agreed to the 1114 declared license change. 1115 It's thus hard to tell whether or not the license change was legit, 1116 but luckily two days later the "doc license" was "put" "back to GPL" 1117 anyway (r1.6). 1118 At the same time the offending comment with a link to the FDL 1119 (not the GPL) was added for no obvious reason. 1120 Now it's gone again. 1121 1122- Regression tests: 1123 - Bump for-privoxy-version to 3.0.27 as we now rely on untrusted 1124 CGI request being rejected with status code 403 (instead of 200). 1125 - Update test for /send-stylesheet and add another one 1126 1127- Templates: 1128 - Consistently use https:// when linking to the Privoxy website. 1129 - Remove SourceForge references in Copyright header. 1130 - Remove a couple of SourceForge references in a comment. 1131 While at it, fix the grammar. 1132 - Move the site-specific documentation block before the generic one. 1133 While most Privoxy installations don't have a site-specific 1134 documentation block, in cases were it exists it's likely to 1135 be more relevant than the generic one. 1136 Showing it first makes it less likely that users stop reading 1137 before they reach it, especially on pages that don't fit on 1138 the screen. 1139 1140- Build system improvements: 1141 - Prefer openjade to jade. On some systems Jade produces 1142 HTML with unescaped ampersands in URLs. 1143 - Prefer OpenSP to SP to be consistent. 1144 - Have Docbook generated HTML files be straight ASCII. 1145 Dealing with a mixture of ISO-8859 and UTF-8 files is problematic. 1146 - Echo the filename to stderr for 'make dok-tidy'. 1147 Make it a bit easier to find errors in docbook generated HTML. 1148 - Warn when still using select(). 1149 - Warn when compiling without calloc(). 1150 - Make it more obvious that the --with-fdsetsize configure switch 1151 is pointless if poll() is available. 1152 - Remove support for AmigaOS. 1153 - Update windows build system to use supported software. 1154 The cygwin gcc -mno-cygwin option is no longer supported, so 1155 convert the windows build system to use the cygwin cross-compiler 1156 to build "native" code. 1157 - Add --enable-static-linking option for configure 1158 does the same thing as LDFLAGS=-static; ./configure 1159 but nicer than mixing evars and configure options. 1160 1161*** Version 3.0.26 stable *** 1162 1163- Bug fixes: 1164 - Fixed crashes with "listen-addr :8118" (SF Bug #902). 1165 The regression was introduced in 3.0.25 beta and reported 1166 by Marvin Renich in Debian bug #834941. 1167 1168- General improvements: 1169 - Log when privoxy is toggled on or off via cgi interface. 1170 - Highlight the "Info: Now toggled " on/off log message 1171 in the Windows log viewer. 1172 - Highlight the loading actions/filter file log message 1173 in the Windows log viewer. 1174 - Mention client-specific tags on the toggle page as a 1175 potentionally more appropriate alternative. 1176 1177- Documentation improvements: 1178 - Update download section on the homepage. 1179 The downloads are available from the website now. 1180 - Add sponsor FAQ. 1181 - Remove obsolete reference to mailing lists hosted at SourceForge. 1182 - Update the "Before the Release" section of the developer manual. 1183 1184- Infrastructure improvements: 1185 - Add perl script to generate an RSS feed for the packages 1186 Submitted by "Unknown". 1187 1188- Build system improvements: 1189 - strptime.h: fix a compiler warning about ambiguous else. 1190 - configure.in: Check for Docbook goo on the BSDs as well. 1191 - GNUMakefile.in: Let the dok-user target remove temporary files. 1192 1193*** Version 3.0.25 beta *** 1194 1195- Bug fixes: 1196 - Always use the current toggle state for new requests. 1197 Previously new requests on reused connections inherited 1198 the toggle state from the previous request even though 1199 the toggle state could have changed. 1200 Reported by Robert Klemme. 1201 - Fixed two buffer-overflows in the (deprecated) static 1202 pcre code. These bugs are not considered security issues 1203 as the input is trusted. 1204 Found with afl-fuzz and ASAN. 1205 1206- General improvements: 1207 - Added support for client-specific tags which allow Privoxy 1208 admins to pre-define tags that are set for all requests from 1209 clients that previously opted in through the CGI interface. 1210 They are useful in multi-user setups where admins may 1211 want to allow users to disable certain actions and filters 1212 for themselves without affecting others. 1213 In single-user setups they are useful to allow more fine-grained 1214 toggling. For example to disable request blocking while still 1215 crunching cookies, or to disable experimental filters only. 1216 This is an experimental feature, the syntax and behaviour may 1217 change in future versions. 1218 Sponsored by Robert Klemme. 1219 - Dynamic filters and taggers now support a $listen-address variable 1220 which contains the address the request came in on. 1221 For external filters the variable is called $PRIVOXY_LISTEN_ADDRESS. 1222 Original patch contributed by pursievro. 1223 - Add client-header-tagger 'listen-address'. 1224 - Include the listen-address in the log message when logging new requests. 1225 Patch contributed by pursievro. 1226 - Turn invalid max-client-connections values into fatal errors. 1227 - The show-status page now shows whether or not dates before 1970 1228 and after 2038 are expected to be handled properly. 1229 This is mainly useful for Privoxy-Regression-Test but could 1230 also come handy when dealing with time-related support requests. 1231 - On Mac OS X the thread id in log messages are more likely to 1232 be unique now. 1233 - When complaining about missing filters, the filter type is logged 1234 as well. 1235 - A couple of harmless coverity warnings were silenced 1236 (CID #161202, CID #161203, CID #161211). 1237 1238- Action file improvements: 1239 - Filtering is disabled for Range requests to let download resumption 1240 and Windows updates work with the default configuration. 1241 - Unblock ".ardmediathek.de/". 1242 Reported by ThTomate in #932. 1243 1244- Documentation improvements: 1245 - Add FAQ entry for crashes caused by memory limits. 1246 - Remove obsolete FAQ entry about a bug in PHP 4.2.3. 1247 - Mention the new mailing lists were appropriate. 1248 As the archives have not been migrated, continue to 1249 mention the archives at SF in the contacting section 1250 for now. 1251 - Note that the templates should be adjusted if Privoxy is 1252 running as intercepting proxy without getting all requests. 1253 - A bunch of links were converted to https://. 1254 - Rephrase onion service paragraph to make it more obvious 1255 that Tor is involved and that the whole website (and not 1256 just the homepage) is available as onion service. 1257 - Streamline the "More information" section on the homepage further 1258 by additionally ditching the link to the 'See also' section 1259 of the user manual. The section contains mostly links that are 1260 directly reachable from the homepage already and the rest is 1261 not significant enough to get a link from the homepage. 1262 - Change the add-header{} example to set the DNT header 1263 and use a complete section to make copy and pasting 1264 more convenient. 1265 Add a comment to make it obvious that adding the 1266 header is not recommended for obvious reasons. 1267 Using the DNT header as example was suggested by 1268 Leo Wzukw. 1269 - Streamline the support-and-service template 1270 Instead of linking to the various support trackers 1271 (whose URLs hopefully change soon), link to the 1272 contact section of the user manual to increase the 1273 chances that users actually read it. 1274 - Add a FAQ entry for tainted sockets. 1275 - More sections in the documentation have stable URLs now. 1276 - FAQ: Explain why 'ping config.privoxy.org' is not expected 1277 to reach a local Privoxy installation. 1278 - Note that donations done through Zwiebelfreunde e.V. currently 1279 can't be checked automatically. 1280 - Updated section regarding starting Privoxy under OS X. 1281 - Use dedicated start instructions for FreeBSD and ElectroBSD. 1282 - Removed release instructions for AIX. They haven't been working 1283 for years and unsurprisingly nobody seems to care. 1284 - Removed obsolete reference to the solaris-dist target. 1285 - Updated the release instructions for FreeBSD. 1286 - Removed unfinished release instructions for Amiga OS and HP-UX 11. 1287 - Added a pointer to the Cygwin Time Machine for getting the last release of 1288 Cygwin version 1.5 to use for building Privoxy on Windows. 1289 - Various typos have been fixed. 1290 1291- Infrastructure improvements: 1292 - The website is no longer hosted at SourceForge and 1293 can be reached through https now. 1294 - The mailing lists at SourceForge have been deprecated, 1295 you can subscribe to the new ones at: https://lists.privoxy.org/ 1296 - Migrating the remaining services from SourceForge is 1297 work in progress (TODO list item #53). 1298 1299- Build system improvements: 1300 - Add configure argument to optimistically redefine FD_SETSIZE 1301 with the intent to change the maximum number of client 1302 connections Privoxy can handle. Only works with some libcs. 1303 Sponsored by Robert Klemme. 1304 - Let the tarball-dist target skip files in ".git". 1305 - Let the tarball-dist target work in cwds other than current. 1306 - Make the 'clean' target faster when run from a git repository. 1307 - Include tools in the generic distribution. 1308 - Let the gen-dist target work in cwds other than current. 1309 - Sort find output that is used for distribution tarballs 1310 to get reproducible results. 1311 - Don't add '-src' to the name of the tar ball generated by the 1312 gen-dist target. The package isn't a source distribution but a 1313 binary package. 1314 While at it, use a variable for the name to reduce the chances 1315 that the various references get out of sync and fix the gen-upload 1316 target which was looking in the wrong directory. 1317 - Add regression-tests.action to the files that are distributed. 1318 - The gen-dist target which was broken since 2002 (r1.92) has been fixed. 1319 - Remove genclspec.sh which has been obsolete since 2009. 1320 - Remove obsolete reference to Redhat spec file. 1321 - Remove the obsolete announce target which has been commented out years ago. 1322 - Let rsync skip files if the checksums match. 1323 1324- Privoxy-Regression-Test: 1325 - Add a "Default level offset" directive which can be used to 1326 change the default level by a given value. 1327 This directive affects all tests located after it until the end 1328 of the file or a another "Default level offset" directive is reached. 1329 The purpose of this directive is to make it more convenient to skip 1330 similar tests in a given file without having to remove or disable 1331 the tests completely. 1332 - Let test level 17 depend on FEATURE_64_BIT_TIME_T 1333 instead of FEATURE_PTHREAD which has no direct connection 1334 to the time_t size. 1335 - Fix indentation in perldoc examples. 1336 - Don't overlook directives in the first line of the action file. 1337 - Bump version to 0.7. 1338 - Fix detection of the Privoxy version now that https:// 1339 is used for the website. 1340 1341*** Version 3.0.24 stable *** 1342 1343- Security fixes (denial of service): 1344 - Prevent invalid reads in case of corrupt chunk-encoded content. 1345 CVE-2016-1982. Bug discovered with afl-fuzz and AddressSanitizer. 1346 - Remove empty Host headers in client requests. 1347 Previously they would result in invalid reads. CVE-2016-1983. 1348 Bug discovered with afl-fuzz and AddressSanitizer. 1349 1350- Bug fixes: 1351 - When using socks5t, send the request body optimistically as well. 1352 Previously the request body wasn't guaranteed to be sent at all 1353 and the error message incorrectly blamed the server. 1354 Fixes #1686 reported by Peter M�ller and G4JC. 1355 - Fixed buffer scaling in execute_external_filter() that could lead 1356 to crashes. Submitted by Yang Xia in #892. 1357 - Fixed crashes when executing external filters on platforms like 1358 Mac OS X. Reported by Jonathan McKenzie on ijbswa-users@. 1359 - Properly parse ACL directives with ports when compiled with HAVE_RFC2553. 1360 Previously the port wasn't removed from the host and in case of 1361 'permit-access 127.0.0.1 example.org:80' Privoxy would try (and fail) 1362 to resolve "example.org:80" instead of example.org. 1363 Reported by Pak Chan on ijbswa-users@. 1364 - Check requests more carefully before serving them forcefully 1365 when blocks aren't enforced. Privoxy always adds the force token 1366 at the beginning of the path, but would previously accept it anywhere 1367 in the request line. This could result in requests being served that 1368 should be blocked. For example in case of pages that were loaded with 1369 force and contained JavaScript to create additionally requests that 1370 embed the origin URL (thus inheriting the force prefix). 1371 The bug is not considered a security issue and the fix does not make 1372 it harder for remote sites to intentionally circumvent blocks if 1373 Privoxy isn't configured to enforce them. 1374 Fixes #1695 reported by Korda. 1375 - Normalize the request line in intercepted requests to make rewriting 1376 the destination more convenient. Previously rewrites for intercepted 1377 requests were expected to fail unless $hostport was being used, but 1378 they failed "the wrong way" and would result in an out-of-memory 1379 message (vanilla host patterns) or a crash (extended host patterns). 1380 Reported by "Guybrush Threepwood" in #1694. 1381 - Enable socket lingering for the correct socket. 1382 Previously it was repeatedly enabled for the listen socket 1383 instead of for the accepted socket. The bug was found by 1384 code inspection and did not cause any (reported) issues. 1385 - Detect and reject parameters for parameter-less actions. 1386 Previously they were silently ignored. 1387 - Fixed invalid reads in internal and outdated pcre code. 1388 Found with afl-fuzz and AddressSanitizer. 1389 - Prevent invalid read when loading invalid action files. 1390 Found with afl-fuzz and AddressSanitizer. 1391 - Windows build: Use the correct function to close the event handle. 1392 It's unclear if this bug had a negative impact on Privoxy's behaviour. 1393 Reported by Jarry Xu in #891. 1394 - In case of invalid forward-socks5(t) directives, use the 1395 correct directive name in the error messages. Previously they 1396 referred to forward-socks4t failures. 1397 Reported by Joel Verhagen in #889. 1398 1399- General improvements: 1400 - Set NO_DELAY flag for the accepting socket. This significantly reduces 1401 the latency if the operating system is not configured to set the flag 1402 by default. Reported by Johan Sintorn in #894. 1403 - Allow to build with mingw x86_64. Submitted by Rustam Abdullaev in #135. 1404 - Introduce the new forwarding type 'forward-webserver'. 1405 Currently it is only supported by the forward-override{} action and 1406 there's no config directive with the same name. The forwarding type 1407 is similar to 'forward', but the request line only contains the path 1408 instead of the complete URL. 1409 - The CGI editor no longer treats 'standard.action' special. 1410 Nowadays the official "standards" are part of default.action 1411 and there's no obvious reason to disallow editing them through 1412 the cgi editor anyway (if the user decided that the lack of 1413 authentication isn't an issue in her environment). 1414 - Improved error messages when rejecting intercepted requests 1415 with unknown destination. 1416 - A couple of log messages now include the number of active threads. 1417 - Removed non-standard Proxy-Agent headers in HTTP snipplets 1418 to make testing more convenient. 1419 - Include the error code for pcre errors Privoxy does not recognize. 1420 - Config directives with numerical arguments are checked more carefully. 1421 - Privoxy's malloc() wrapper has been changed to prevent zero-size 1422 allocations which should only occur as the result of bugs. 1423 - Various cosmetic changes. 1424 1425- Action file improvements: 1426 - Unblock ".deutschlandradiokultur.de/". 1427 Reported by u302320 in #924. 1428 - Add two fast-redirect exceptions for "yandex.ru". 1429 - Disable filter{banners-by-size} for ".plasmaservice.de/". 1430 - Unblock "klikki.fi/adv/". 1431 - Block requests for "resources.infolinks.com/". 1432 Reported by "Black Rider" on ijbswa-users@. 1433 - Block a bunch of criteo domains. 1434 Reported by Black Rider. 1435 - Block "abs.proxistore.com/abe/". 1436 Reported by Black Rider. 1437 - Disable filter{banners-by-size} for ".black-mosquito.org/". 1438 - Disable fast-redirects for "disqus.com/". 1439 1440- Documentation improvements: 1441 - FAQ: Explicitly point fingers at ASUS as an example of a 1442 company that has been reported to force malware based on 1443 Privoxy upon its customers. 1444 - Correctly document the action type for a bunch of "multi-value" 1445 actions that were incorrectly documented to be "parameterized". 1446 Reported by Gregory Seidman on ijbswa-users@. 1447 - Fixed the documented type of the forward-override{} action 1448 which is obviously 'parameterized'. 1449 1450- Website improvements: 1451 - Users who don't trust binaries served by SourceForge 1452 can get them from a mirror. Migrating away from SourceForge 1453 is planned for 2016 (TODO list item #53). 1454 - The website is now available as onion service 1455 (http://jvauzb4sb3bwlsnc.onion/). 1456 1457*** Version 3.0.23 stable *** 1458 1459- Bug fixes: 1460 - Fixed a DoS issue in case of client requests with incorrect 1461 chunk-encoded body. When compiled with assertions enabled 1462 (the default) they could previously cause Privoxy to abort(). 1463 Reported by Matthew Daley. CVE-2015-1380. 1464 - Fixed multiple segmentation faults and memory leaks in the 1465 pcrs code. This fix also increases the chances that an invalid 1466 pcrs command is rejected as such. Previously some invalid commands 1467 would be loaded without error. Note that Privoxy's pcrs sources 1468 (action and filter files) are considered trustworthy input and 1469 should not be writable by untrusted third-parties. CVE-2015-1381. 1470 - Fixed an 'invalid read' bug which could at least theoretically 1471 cause Privoxy to crash. So far, no crashes have been observed. 1472 CVE-2015-1382. 1473 - Compiles with --disable-force again. Reported by Kai Raven. 1474 - Client requests with body that can't be delivered no longer 1475 cause pipelined requests behind them to be rejected as invalid. 1476 Reported by Basil Hussain. 1477 1478- General improvements: 1479 - If a pcrs command is rejected as invalid, Privoxy now logs 1480 the cause of the problem as text. Previously the pcrs error 1481 code was logged. 1482 - The tests are less likely to cause false positives. 1483 1484- Action file improvements: 1485 - '.sify.com/' is no longer blocked. Apparently it is not actually 1486 a pure tracking site (anymore?). Reported by Andrew on ijbswa-users@. 1487 - Unblock banners on .amnesty.de/ which aren't ads. 1488 1489- Documentation improvements: 1490 - The 'Would you like to donate?' section now also contains 1491 a "Paypal" address. 1492 - The list of supported operating systems has been updated. 1493 - The existence of the SF support and feature trackers has been 1494 deemphasized because they have been broken for months. 1495 Most of the time the mailing lists still work. 1496 - The claim that default.action updates are sometimes released 1497 on their own has been removed. It hasn't happened in years. 1498 - Explicitly mention that Tor's port may deviate from the default 1499 when using a bundle. Requested by Andrew on ijbswa-users@. 1500 1501*** Version 3.0.22 stable *** 1502 1503- Bug fixes: 1504 - Fixed a memory leak when rejecting client connections due to 1505 the socket limit being reached (CID 66382). This affected 1506 Privoxy 3.0.21 when compiled with IPv6 support (on most 1507 platforms this is the default). CVE-2015-1030. 1508 - Fixed an immediate-use-after-free bug (CID 66394) and two 1509 additional unconfirmed use-after-free complaints made by 1510 Coverity scan (CID 66391, CID 66376). CVE-2015-1031. 1511 - Actually show the FORCE_PREFIX value on the show-status page. 1512 - Properly deal with Keep-Alive headers with timeout= parameters 1513 If the timeout still can't be parsed, use the configured 1514 timeout instead of preventing the client from keeping the 1515 connection alive. Fixes #3615312/#870 reported by Bernard Guillot. 1516 - Not using any filter files no longer results in warning messages 1517 unless an action file is referencing header taggers or filters. 1518 Reported by Stefan Kurtz in #3614835. 1519 - Fixed a bug that prevented Privoxy from reusing some reusable 1520 connections. Two bit masks with different purpose unintentionally 1521 shared the same bit. 1522 - A couple of additional bugs were discovered by Coverity Scan. 1523 The fixes that are not expected to affect users are not explicitly 1524 mentioned here, for details please have a look at the CVS logs. 1525 1526- General improvements: 1527 - Introduced negative tag patterns NO-REQUEST-TAG and NO-RESPONSE-TAG. 1528 They apply if no matching tag is found after parsing client or 1529 server headers. 1530 - Add support for external filters which allow to process the 1531 response body with a script or program written in any language 1532 the platform supports. External filters are enabled with 1533 +external-filter{} after they have been defined in one of the 1534 filter files with a header line starting with "EXTERNAL-FILTER:". 1535 External filter support is experimental, not compiled by default 1536 and known not to work on all platforms. 1537 - Add support for the 'PATCH' method as defined in RFC5789. 1538 - Reject requests with unsupported Expect header values. 1539 Fixes a couple of Co-Advisor tests. 1540 - Normalize the HTTP-version in forwarded requests and responses. 1541 This is an explicit RFC 2616 MUST and RFC 7230 mandates that 1542 intermediaries send their own HTTP-version in forwarded 1543 messages. 1544 - Server 'Keep-Alive' headers are no longer forwarded. From a user's 1545 point of view it doesn't really matter, but RFC 2616 (obsolete) 1546 mandates that the header is removed and this fixes a Co-Advisor 1547 complaint. 1548 - Change declared template file encoding to UTF-8. The templates 1549 already used a subset of UTF-8 anyway and changing the declaration 1550 allows to properly display UTF-8 characters used in the action files. 1551 This change may require existing action files with ISO-8859-1 1552 characters that aren't valid UTF-8 to be converted to UTF-8. 1553 Requested by Sam Chen in #582. 1554 - Do not pass rejected keep-alive timeouts to the server. It might 1555 not have caused any problems (we know of), but doing the right 1556 thing shouldn't hurt either. 1557 - Let log_error() use its own buffer size #define to make changing 1558 the log buffer size slightly less inconvenient. 1559 - Turned single-threaded into a "proper" toggle directive with arguments. 1560 - CGI templates no longer enforce new windows for some links. 1561 - Remove an undocumented workaround ('HOST' header removal) for 1562 an Apple iTunes bug that according to #729900 got fixed in 2003. 1563 1564- Action file improvements: 1565 - The pattern 'promotions.' is no longer being blocked. 1566 Reported by rakista in #3608540. 1567 - Disable fast-redirects for .microsofttranslator.com/. 1568 - Disable filter{banners-by-size} for .dgb-tagungszentren.de/. 1569 - Add adn.speedtest.net as a site-specific unblocker. 1570 Support request #3612908. 1571 - Disable filter{banners-by-size} for creativecommons.org/. 1572 - Block requests to data.gosquared.com/. Reported by cbug in #3613653. 1573 - Unblock .conrad./newsletter/. Reported by David Bo in #3614238. 1574 - Unblock .bundestag.de/. 1575 - Unblock .rote-hilfe.de/. 1576 - Disable fast-redirects for .facebook.com/plugins/like.php. 1577 - Unblock Stackexchange popup URLs that aren't used to serve ads. 1578 Reported by David Wagner in #3615179. 1579 - Disable fast-redirects for creativecommons.org/. 1580 - Unblock .stopwatchingus.info/. 1581 - Block requests for .adcash.com/script/. 1582 Reported by Tyrexionibus in #3615289. 1583 - Disable HTML filters if the response was tagged as JavaScript. 1584 Filtering JavaScript code with filters intended to deal with HTML 1585 is usually a waste of time and, more importantly, may break stuff. 1586 - Use a custom redirect{} for .washingtonpost.com/wp-apps/imrs\.php\?src= 1587 Previously enabling the 'Advanced' settings (or manually enabling 1588 +fast-redirects{}) prevented some images from being loaded properly. 1589 - Unblock "adina*." Fixes #919 reported by Morton A. Goldberg. 1590 - Block '/.*DigiAd'. 1591 - Unblock 'adele*.'. Reported by Adele Lime in #1663. 1592 - Disable banners-by-size for kggp.de/. 1593 1594- Filter file improvements & bug fixes: 1595 - Decrease the chances that js-annoyances creates invalid JavaScript. 1596 Submitted by John McGowan on ijbswa-users@. 1597 - Let the msn filter hide 'related' ads again. 1598 - Remove a stray '1' in the 'html-annoyances' filter. 1599 - Prevent img-reorder from messing up img tags with empty src 1600 attributes. Fixes #880 reported by Duncan. 1601 1602- Documentation improvements: 1603 - Updated the 'Would you like to donate?' section. 1604 - Note that invalid forward-override{} parameter syntax isn't 1605 detected until the parameter is used. 1606 - Add another +redirect{} example: a shortcut for illumos bugs. 1607 - Make it more obvious that many operating systems support log 1608 rotation out of the box. 1609 - Fixed dead links. Reported by Mark Nelson in #3614557. 1610 - Rephrased the 'Why is the configuration so complicated?' answer 1611 to be slightly less condescending. Anonymously suggested in #3615122. 1612 - Be more explicit about accept-intercepted-requests's lack of MITM support. 1613 - Make 'demoronizer' FAQ entries more generic. 1614 - Add an example hostname to the --pre-chroot-nslookup description. 1615 - Add an example for a host pattern that matches an IP address. 1616 - Rename the 'domain pattern' to 'host pattern' as it may 1617 contain IP addresses as well. 1618 - Recommend forward-socks5t when using Tor. It seems to work fine and 1619 modifying the Tor configuration to profit from it hasn't been necessary 1620 for a while now. 1621 - Add another redirect{} example to stress that redirect loops can 1622 and should be avoided. 1623 - The usual spelling and grammar fixes. Parts of them were 1624 reported by Reuben Thomas in #3615276. 1625 - Mention the PCRS option letters T and D in the filter section. 1626 - Clarify that handle-as-empty-doc-returns-ok is still useful 1627 and will not be removed without replacement. 1628 - Note that security issues shouldn't be reported using the bug tracker. 1629 - Clarify what Privoxy does if both +block{} and +redirect{} apply. 1630 - Removed the obsolete bookmarklets section. 1631 1632- Build system improvements: 1633 - Let --with-group properly deal with secondary groups. 1634 Patch submitted by Anatoly Arzhnikov in #3615187. 1635 - Fix web-actions target. 1636 - Add a web-faq target that only updates the FAQ on the webserver. 1637 - Remove already-commented-out non-portable DOSFILTER alternatives. 1638 - Remove the obsolete targets dok-put and dok-get. 1639 - Add a sf-shell target. 1640 1641*** Version 3.0.21 stable *** 1642 1643- Bug fixes: 1644 - On POSIX-like platforms, network sockets with file descriptor 1645 values above FD_SETSIZE are properly rejected. Previously they 1646 could cause memory corruption in configurations that allowed 1647 the limit to be reached. 1648 - Proxy authentication headers are removed unless the new directive 1649 enable-proxy-authentication-forwarding is used. Forwarding the 1650 headers potentially allows malicious sites to trick the user 1651 into providing them with login information. 1652 Reported by Chris John Riley. 1653 - Compiles on OS/2 again now that unistd.h is only included 1654 on platforms that have it. 1655 1656- General improvements: 1657 - The show-status page shows the FEATURE_STRPTIME_SANITY_CHECKS status. 1658 - A couple of assert()s that could theoretically dereference 1659 NULL pointers in debug builds have been relocated. 1660 - Added an LSB info block to the generic start script. 1661 Based on a patch from Natxo Asenjo. 1662 - The max-client-connections default has been changed to 128 1663 which should be more than enough for most setups. 1664 1665- Action file improvements: 1666 - Block rover.ebay./ar.*\&adtype= instead of "/.*\&adtype=" which 1667 caused too man false positives. 1668 Reported by u302320 in #360284, additional feedback from Adam Piggott. 1669 - Unblock '.advrider.com/' and '/.*ADVrider'. 1670 Anonymously reported in #3603636. 1671 - Stop blocking '/js/slider\.js'. 1672 Reported by Adam Piggott in #3606635 and _lvm in #2791160. 1673 1674- Filter file improvements: 1675 - Added an iframes filter. 1676 1677- Documentation improvements: 1678 - The whole GPLv2 text is included in the user manual now, 1679 so Privoxy can serve it itself and the user can read it 1680 without having to wade through GPLv3 ads first. 1681 - Properly numbered and underlined a couple of section titles 1682 in the config that where previously overlooked due to a flaw 1683 in the conversion script. Reported by Ralf Jungblut. 1684 - Improved the support instruction to hopefully make it harder to 1685 unintentionally provide insufficient information when requesting 1686 support. Previously it wasn't obvious that the information we need 1687 in bug reports is usually also required in support requests. 1688 - Removed documentation about packages that haven't been provided 1689 in years. 1690 1691- Privoxy-Regression-Test: 1692 - Only log the test number when not running in verbose mode 1693 The position of the test is rarely relevant and it previously 1694 wasn't exactly obvious which one of the numbers was useful to 1695 repeat the test with --test-number. 1696 1697- GNUmakefile improvements: 1698 - Factor generate-config-file out of config-file to make testing 1699 more convenient. 1700 - The clean target now also takes care of patch leftovers. 1701 1702*** Version 3.0.20 beta *** 1703 1704- Bug fixes: 1705 - Client sockets are now properly shutdown and drained before being 1706 closed. This fixes page truncation issues with clients that aggressively 1707 pipeline data on platforms that otherwise discard already written data. 1708 The issue mainly affected Opera users and was initially reported 1709 by Kevin in #3464439, szotsaki provided additional information to track 1710 down the cause. 1711 - Fix latency calculation for shared connections (disabled by default). 1712 It was broken since their introduction in 2009. The calculated latency 1713 for most connections would be 0 in which case the timeout detection 1714 failed to account for the real latency. 1715 - Reject URLs with invalid port. Previously they were parsed incorrectly and 1716 characters between the port number and the first slash were silently 1717 dropped as shown by curl test 187. 1718 - The default-server-timeout and socket-timeout directives accept 0 as 1719 valid value. 1720 - Fix a race condition on Windows that could cause Privoxy to become 1721 unresponsive after toggling it on or off through the taskbar icon. 1722 Reported by Tim H. in #3525694. 1723 - Fix the compilation on Windows when configured without IPv6 support. 1724 - Fix an assertion that could cause debug builds to abort() in case of 1725 socks5 connection failures with "debug 2" enabled. 1726 - Fix an assertion that could cause debug builds to abort() if a filter 1727 contained nul bytes in the replacement text. 1728 1729- General improvements: 1730 - Significantly improved keep-alive support for both client and server 1731 connections. 1732 - New debug log level 65536 which logs all actions that were applied to 1733 the request. 1734 - New directive client-header-order to forward client headers in a 1735 different order than the one in which they arrived. 1736 - New directive tolerate-pipelining to allow client-side pipelining. 1737 If enabled (3.0.20 beta enables it by default), Privoxy will keep 1738 pipelined client requests around to deal with them once the current 1739 request has been served. 1740 - New --config-test option to let Privoxy exit after checking whether or not 1741 the configuration seems valid. The limitations noted in TODO #22 and #23 1742 still apply. Based on a patch by Ramkumar Chinchani. 1743 - New limit-cookie-lifetime{} action to let cookies expire before the end 1744 of the session. Suggested by Rick Sykes in #1049575. 1745 - Increase the hard-coded maximum number of actions and filter files from 1746 10 to 30 (each). It doesn't significantly affect Privoxy's memory usage 1747 and recompiling wasn't an option for all Privoxy users that reached the 1748 limit. 1749 - Add support for chunk-encoded client request bodies. Previously 1750 chunk-encoded request bodies weren't guaranteed to be forwarded correctly, 1751 so this can also be considered a bug fix although chunk-encoded request 1752 bodies aren't commonly used in the real world. 1753 - Add support for Tor's optimistic-data SOCKS extension, which can reduce the 1754 latency for requests on newly created connections. Currently only the 1755 headers are sent optimistically and only if the client request has already 1756 been read completely which rules out requests with large bodies. 1757 - After preventing the client from pipelining, don't signal keep-alive 1758 intentions. When looking at the response headers alone, it previously 1759 wasn't obvious from the client's perspective that no additional responses 1760 should be expected. 1761 - Stop considering client sockets tainted after receiving a request with body. 1762 It hasn't been necessary for a while now and unnecessarily causes test 1763 failures when using curl's test suite. 1764 - Allow HTTP/1.0 clients to signal interest in keep-alive through the 1765 Proxy-Connection header. While such client are rare in the real world, it 1766 doesn't hurt and couple of curl tests rely on it. 1767 - Only remove duplicated Content-Type headers when filters are enabled. 1768 If they are not it doesn't cause ill effects and the user might not want it. 1769 Downgrade the removal message to LOG_LEVEL_HEADER to clarify that it's not 1770 an error in Privoxy and is unlikely to cause any problems in general. 1771 Anonymously reported in #3599335. 1772 - Set the socket option SO_LINGER for the client socket. 1773 - Move several variable declarations to the beginning of their code block. 1774 It's required when compiling with gcc 2.95 which is still used on some 1775 platforms. Initial patch submitted by Simon South in #3564815. 1776 - Optionally try to sanity-check strptime() results before trusting them. 1777 Broken strptime() implementations have caused problems in the past and 1778 the most recent offender seems to be FreeBSD's libc (standards/173421). 1779 - When filtering is enabled, let Range headers pass if the range starts at 1780 the beginning. This should work around (or at least reduce) the video 1781 playback issues with various Apple clients as reported by Duc in #3426305. 1782 - Do not confuse a client hanging up with a connection time out. If a client 1783 closes its side of the connection without sending a request line, do not 1784 send the CLIENT_CONNECTION_TIMEOUT_RESPONSE, but report the condition 1785 properly. 1786 - Allow closing curly braces as part of action values as long as they are 1787 escaped. 1788 - On Windows, the logfile is now written before showing the GUI error 1789 message which blocks until the user acknowledges it. 1790 Reported by Adriaan in #3593603. 1791 - Remove an unreasonable parameter limit in the CGI interface. The new 1792 parameter limit depends on the memory available and is currently unlikely 1793 to be reachable, due to other limits in both Privoxy and common clients. 1794 Reported by Andrew on ijbswa-users@. 1795 - Decrease the chances of parse failures after requests with unsupported 1796 methods were sent to the CGI interface. 1797 1798- Action file improvements: 1799 - Remove the comment that indicated that updated default.action versions 1800 are released on their own. 1801 - Block 'optimize.indieclick.com/' and 'optimized-by.rubiconproject.com/' 1802 - Unblock 'adjamblog.wordpress.com/' and 'adjamblog.files.wordpress.com/'. 1803 Reported by Ryan Farmer in #3496116. 1804 - Unblock '/.*Bugtracker'. Reported by pwhk in #3522341. 1805 - Add test URLs for '.freebsd.org' and '.watson.org'. 1806 - Unblock '.urbandictionary.com/popular'. 1807 - Block '.adnxs.com/'. 1808 - Block 'farm.plista.com/widgetdata.php'. 1809 - Block 'rotation.linuxnewmedia.com/'. 1810 - Block 'reklamy.sfd.pl/'. Reported by kacperdominik in #3399948. 1811 - Block 'g.adspeed.net/'. 1812 - Unblock 'websupport.wdc.com/'. Reported by Adam Piggot in #3577851. 1813 - Block '/openx/www/delivery/'. 1814 - Disable fast-redirects for '.googleapis.com/'. 1815 - Block 'imp.double.net/'. Reported by David Bo in #3070411. 1816 - Block 'gm-link.com/' which is used for email tracking. 1817 Reported by David Bo in #1812733. 1818 - Verify that requests to "bwp." are blocked. URL taken from #1736879 1819 submitted by Francois Marier. 1820 - Block '/.*bannerid='. Reported by Adam Piggott in #2975779. 1821 - Block 'cltomedia.info/delivery/' and '.adexprt.com/'. 1822 Anonymously reported in #2965254. 1823 - Block 'de17a.com/'. Reported by David Bo in #3061472. 1824 - Block 'oskar.tradera.com/'. Reported by David Bo in #3060596. 1825 - Block '/scripts/webtrends\.js'. Reported by johnd16 in #3002729. 1826 - Block requests for 'pool.*.adhese.com/'. Reported by johnd16 in #3002716. 1827 - Update path pattern for Coremetrics and add tests. 1828 Pattern and URLs submitted by Adam Piggott #3168443. 1829 - Enable +fast-redirects{check-decoded-url} for 'tr.anp.se/'. 1830 Reported by David Bo in #3268832. 1831 - Unblock '.conrad.se/newsletter/banners/'. Reported by David Bo in #3413824. 1832 - Block '.tynt.com/'. Reported by Dan Stahlke in #3421767. 1833 - Unblock '.bbci.co.uk/radio/'. Reported by Adam Piggott in #3569603. 1834 - Block requests to 'service.maxymiser.net/'. 1835 Reported by johnd16 in #3118401 (with a previous URL). 1836 - Disable fast-redirects for Google's "let's pretend your computer is 1837 infected" page. 1838 - Unblock '/.*download' to resolve actionsfile feedback #3498129. 1839 Submitted by Steven Kolins (soundcloud.com not working). 1840 - Unblock '.wlxrs.com/' which is required by hotmail.com. 1841 Fixes #3413827 submitted by David Bo. 1842 - Add two unblock patterns for popup radio and TV players. 1843 Submitted by Adam Piggott in #3596089. 1844 1845- Filter file improvements & bug fixes: 1846 - Add a referer tagger. 1847 - Reduce the likelihood that the google filter messes up HTML-generating 1848 JavaScript. Reported by Zeno Kugy in #3520260. 1849 1850- Documentation improvements: 1851 - Revised all OS X sections due to new packaging module (OSXPackageBuilder). 1852 - Update the list of supported operating systems to clarify that all Windows 1853 versions after 95 are expected to work and note that the platform-specific 1854 code for AmigaOS and QNX currently isn't maintained. 1855 - Update 'Signals' section, the only explicitly handled signals are SIGINT, 1856 SIGTERM and SIGHUP. 1857 - Add Haiku to the list of operating systems on which Privoxy is known to 1858 run. 1859 - Add DragonFly to the list of BSDs on which Privoxy is known to run. 1860 - Removed references to redhat-specific documentation set since it no longer 1861 exists. 1862 - Removed references to building PDFs since we no longer do so. 1863 - Multiple listen-address directives are supported since 3.0.18, correct the 1864 documentation to say so. 1865 - Remove bogus section about long and short being preferable to int. 1866 - Corrected some Internet JunkBuster references to Privoxy. 1867 - Removed references to www.junkbusters.com since it is no longer 1868 maintained. Reported by Angelina Matson. 1869 - Various grammar and spelling corrections 1870 - Add a client-header-tagger{} example for disabling filtering for range 1871 requests. 1872 - Correct a URL in the "Privoxy with Tor" FAQ. 1873 - Spell 'refresh-tags' correctly. Reported by Don in #3571927. 1874 - Sort manpage options alphabetically. 1875 - Remove an incorrect sentence in the toggle section. The toggle state 1876 doesn't affect whether or not the Windows version uses the tray icon. 1877 Reported by Zeno Kugy in #3596395. 1878 - Add new contributors since 3.0.19. 1879 1880- Log message improvements: 1881 - When stopping to watch a client socket due to pipelining, additionally log 1882 the socket number. 1883 - Log the client socket and its condition before closing it. This makes it 1884 more obvious that the socket actually gets closed and should help when 1885 diagnosing problems like #3464439. 1886 - In case of SOCKS5 failures, do not explicitly log the server's response. 1887 It hasn't helped so far and the response can already be logged by enabling 1888 "debug 32768" anyway. This reverts v1.81 and the follow-up bug fix v1.84. 1889 - Relocate the connection-accepted message from listen_loop() to serve(). 1890 This way it's printed by the thread that is actually serving the 1891 connection which is nice when grepping for thread ids in log files. 1892 1893- Code cleanups: 1894 - Remove compatibility layer for versions prior to 3.0 since it has been 1895 obsolete for more than 10 years now. 1896 - Remove the ijb_isupper() and ijb_tolower() macros from parsers.c since 1897 they aren't used in this file. 1898 - Removed the 'Functions declared include:' comment sections since they tend 1899 to be incomplete, incorrect and out of date and the benefit seems 1900 questionable. 1901 - Various comment grammar and comprehensibility improvements. 1902 - Remove a pointless fflush() call in chat(). Flushing all streams pretty 1903 much all the time for no obvious reason is ridiculous. 1904 - Relocate ijb_isupper()'s definition to project.h and get the ijb_tolower() 1905 definition from there, too. 1906 - Relocate ijb_isdigit()'s definition to project.h. 1907 - Rename ijb_foo macros to privoxy_foo. 1908 - Add malloc_or_die() which will allow to simplify code paths where malloc() 1909 failures don't need to be handled gracefully. 1910 - Add strdup_or_die() which will allow to simplify code paths where strdup() 1911 failures don't need to be handled gracefully. 1912 - Replace strdup() calls with strdup_or_die() calls where it's safe and 1913 simplifies the code. 1914 - Fix white-space around parentheses. 1915 - Add missing white-space behind if's and the following parentheses. 1916 - Unwrap a memcpy() call in resolve_hostname_to_ip(). 1917 - Declare pcrs_get_delimiter()'s delimiters[] static const. 1918 - Various optimisations to remove dead code and merge inefficient code 1919 structures for improved clarity, performance or code compactness. 1920 - Various data type corrections. 1921 - Change visibility of several code segments when compiling without 1922 FEATURE_CONNECTION_KEEP_ALIVE enabled for clarity. 1923 - In pcrs_get_delimiter(), do not use delimiters outside the ASCII range. 1924 Fixes a clang complaint. 1925 - Fix an error message in get_last_url() nobody is supposed to see. 1926 Reported by Matthew Fischer in #3507301. 1927 - Fix a typo in the no-zlib-support complaint. Patch submitted by Matthew 1928 Fischer in #3507304. 1929 - Shorten ssplit()'s prototype by removing the last two arguments. We always 1930 want to skip empty fields and ignore leading delimiters, so having 1931 parameters for this only complicates the API. 1932 - Use an enum for the type of the action value. 1933 - Rename action_name's member takes_value to value_type as it isn't used as 1934 boolean. 1935 - Turn family mismatches in match_sockaddr() into fatal errors. 1936 - Let enlist_unique_header() verify that the caller didn't pass a header 1937 containing either \r or \n. 1938 - Change the hashes used in load_config() to unsigned int. That's what 1939 hash_string() actually returns and using a potentially larger type 1940 is at best useless. 1941 - Use privoxy_tolower() instead of vanilla tolower() with manual casting of 1942 the argument. 1943 - Catch ssplit() failures in parse_cgi_parameters(). 1944 1945- Privoxy-Regression-Test: 1946 - Add an 'Overwrite condition' directive to skip any matching tests before 1947 it. As it has a global scope, using it is more convenient than clowning 1948 around with the Ignore directive. 1949 - Log to STDOUT instead of STDERR. 1950 - Include the Privoxy version in the output. 1951 - Various grammar and spelling corrections in documentation and code. 1952 - Additional tests for range requests with filtering enabled. 1953 - Tests with mostly invalid range request. 1954 - Add a couple of hide-if-modified-since{} tests with different date formats. 1955 - Cleaned up the format of the regression-tests.action file to match the 1956 format of default.action. 1957 - Remove the "Copyright" line from print_version(). When using --help, every 1958 line of screen space matters and thus shouldn't be wasted on things the 1959 user doesn't care about. 1960 1961- Privoxy-Log-Parser: 1962 - Improve the --statistics performance by skipping sanity checks for input 1963 that shouldn't affect the results anyway. Add a --strict-checks option 1964 that enables some of the checks again, just in case anybody cares. 1965 - The distribution of client requests per connection is included in 1966 the --statistic output. 1967 - The --accept-unknown-messages option has been removed and the behavior 1968 is now the default. 1969 - Accept and (mostly) highlight new log messages introduced with 1970 Privoxy 3.0.20. 1971 1972- uagen: 1973 - Bump generated Firefox version to 17. 1974 1975- GNUmakefile improvements: 1976 - The dok-tidy target no longer taints documents with a tidy-mark 1977 - Change RA_MODE from 0664 to 0644. Suggested by Markus Dittrich in 1978 #3505445. 1979 - Remove tidy's clean flag as it changes the scope of attributes. 1980 Link-specific colors end up being applied to all text. Reported by Adam 1981 Piggott in #3569551. 1982 - Leave it up to the user whether or not smart tags are inserted. 1983 - Let w3m itself do the line wrapping for the config file. It works better 1984 than fmt as it can honour pre tags causing less unintentional line breaks. 1985 - Ditch a pointless '-r' passed to rm to delete files. 1986 - The config-file target now requires less manual intervention and updates 1987 the original config. 1988 - Change WDUMP to generate ASCII. Add WDUMP_UTF8 to allow UTF-8 in the 1989 AUTHORS file so the names are right. 1990 - Stop pretending that lynx and links are supported for the documentation. 1991 1992- configure improvements: 1993 - On Haiku, do not pass -lpthread to the compiler. Haiku's pthreads 1994 implementation is contained in its system library, libroot, so no 1995 additional library needs to be searched. 1996 Patch submitted by Simon South in #3564815. 1997 - Additional Haiku-specific improvements. Disable checks intended for 1998 multi-user systems as Haiku is presently single-user. Group Haiku-specific 1999 settings in their own section, following the pattern for Solaris, OS/2 and 2000 AmigaOS. Add additional library-related settings to remove the need for 2001 providing configure with custom LDFLAGS. 2002 Submitted by Simon South in #3574538. 2003 2004*** Version 3.0.19 Stable *** 2005 2006- Bug fixes: 2007 - Prevent a segmentation fault when de-chunking buffered content. 2008 It could be triggered by malicious web servers if Privoxy was 2009 configured to filter the content and running on a platform 2010 where SIZE_T_MAX isn't larger than UINT_MAX, which probably 2011 includes most 32-bit systems. On those platforms, all Privoxy 2012 versions before 3.0.19 appear to be affected. 2013 To be on the safe side, this bug should be presumed to allow 2014 code execution as proving that it doesn't seems unrealistic. 2015 - Do not expect a response from the SOCKS4/4A server until it 2016 got something to respond to. This regression was introduced 2017 in 3.0.18 and prevented the SOCKS4/4A negotiation from working. 2018 Reported by qqqqqw in #3459781. 2019 2020- General improvements: 2021 - Fix an off-by-one in an error message about connect failures. 2022 - Use a GNUMakefile variable for the webserver root directory and 2023 update the path. Sourceforge changed it which broke various 2024 web-related targets. 2025 - Update the CODE_STATUS description. 2026 2027*** Version 3.0.18 Stable *** 2028 2029- Bug fixes: 2030 - If a generated redirect URL contains characters RFC 3986 doesn't 2031 permit, they are (re)encoded. Not doing this makes Privoxy versions 2032 from 3.0.5 to 3.0.17 susceptible to HTTP response splitting (CWE-113) 2033 attacks if the +fast-redirects{check-decoded-url} action is used. 2034 - Fix a logic bug that could cause Privoxy to reuse a server 2035 socket after it got tainted by a server-header-tagger-induced 2036 block that was triggered before the whole server response had 2037 been read. If keep-alive was enabled and the request following 2038 the blocked one was to the same host and using the same forwarding 2039 settings, Privoxy would send it on the tainted server socket. 2040 While the server would simply treat it as a pipelined request, 2041 Privoxy would later on fail to properly parse the server's 2042 response as it would try to parse the unread data from the 2043 first response as server headers for the second one. 2044 Regression introduced in 3.0.17. 2045 - When implying keep-alive in client_connection(), remember that 2046 the client didn't. Fixes a regression introduced in 3.0.13 that 2047 would cause Privoxy to wait for additional client requests after 2048 receiving a HTTP/1.1 request with "Connection: close" set 2049 and connection sharing enabled. 2050 With clients which terminates the client connection after detecting 2051 that the whole body has been received it doesn't really matter, 2052 but with clients that don't the connection would be kept open until 2053 it timed out. 2054 - Fix a subtle race condition between prepare_csp_for_next_request() 2055 and sweep(). A thread preparing itself for the next client request 2056 could briefly appear to be inactive. 2057 If all other threads were already using more recent files, 2058 the thread could get its files swept away under its feet. 2059 So far this has only been reproduced while stress testing in 2060 valgrind while touching action files in a loop. It's unlikely 2061 to have caused any actual problems in the real world. 2062 - Disable filters if SDCH compression is used unless filtering is forced. 2063 If SDCH was combined with a supported compression algorithm, Privoxy 2064 previously could try to decompress it and ditch the Content-Encoding 2065 header even though the SDCH compression wasn't dealt with. 2066 Reported by zebul666 in #3225863. 2067 - Make a copy of the --user value and only mess with that when splitting 2068 user and group. On some operating systems modifying the value directly 2069 is reflected in the output of ps and friends and can be misleading. 2070 Reported by zepard in #3292710. 2071 - If forwarded-connect-retries is set, only retry if Privoxy is actually 2072 forwarding the request. Previously direct connections would be retried 2073 as well. 2074 - Fixed a small memory leak when retrying connections with IPv6 2075 support enabled. 2076 - Remove an incorrect assertion in compile_dynamic_pcrs_job_list() 2077 It could be triggered by a pcrs job with an invalid pcre 2078 pattern (for example one that contains a lone quantifier). 2079 - If the --user argument user[.group] contains a dot, always bail out 2080 if no group has been specified. Previously the intended, but undocumented 2081 (and apparently untested), behaviour was to try interpreting the whole 2082 argument as user name, but the detection was flawed and checked for '0' 2083 instead of '\0', thus merely preventing group names beginning with a zero. 2084 - In html_code_map[], use a numeric character reference instead of ' 2085 which wasn't standardized before XHTML 1.0. 2086 - Fix an invalid free when compiled with FEATURE_GRACEFUL_TERMINATION 2087 and shut down through http://config.privoxy.org/die 2088 - In get_actions(), fix the "temporary" backwards compatibility hack 2089 to accept block actions without reason. 2090 It also covered other actions that should be rejected as invalid. 2091 Reported by Billy Crook. 2092 2093- General improvements: 2094 - Privoxy can (re)compress buffered content before delivering 2095 it to the client. Disabled by default as most users wouldn't 2096 benefit from it. 2097 - The +fast-redirects{check-decoded-url} action checks URL 2098 segments separately. If there are other parameters behind 2099 the redirect URL, this makes it unnecessary to cut them off 2100 by additionally using a +redirect{} pcrs command. 2101 Initial patch submitted by Jamie Zawinski in #3429848. 2102 - When loading action sections, verify that the referenced filters 2103 exist. Currently missing filters only result in an error message, 2104 but eventually the severity will be upgraded to fatal. 2105 - Allow to bind to multiple separate addresses. 2106 Patch set submitted by Petr Pisar in #3354485. 2107 - Set socket_error to errno if connecting fails in rfc2553_connect_to(). 2108 Previously rejected direct connections could be incorrectly reported 2109 as DNS issues if Privoxy was compiled with IPv6 support. 2110 - Adjust url_code_map[] so spaces are replaced with %20 instead of '+' 2111 While '+' can be used by client's submitting form data, this is not 2112 actually what Privoxy is using the lookups for. This is more of a 2113 cosmetic issue and doesn't fix any known problems. 2114 - When compiled without FEATURE_FAST_REDIRECTS, do not silently 2115 ignore +fast-redirect{} directives 2116 - Added a workaround for GNU libc's strptime() reporting negative 2117 year values when the parsed year is only specified with two digits. 2118 On affected systems cookies with such a date would not be turned 2119 into session cookies by the +session-cookies-only action. 2120 Reported by Vaeinoe in #3403560 2121 - Fixed bind failures with certain GNU libc versions if no non-loopback 2122 IP address has been configured on the system. This is mainly an issue 2123 if the system is using DHCP and Privoxy is started before the network 2124 is completely configured. 2125 Reported by Raphael Marichez in #3349356. 2126 Additional insight from Petr Pisar. 2127 - Privoxy log messages now use the ISO 8601 date format %Y-%m-%d. 2128 It's only slightly longer than the old format, but contains 2129 the full date including the year and allows sorting by date 2130 (when grepping in multiple log files) without hassle. 2131 - In get_last_url(), do not bother trying to decode URLs that do 2132 not contain at least one '%' sign. It reduces the log noise and 2133 a number of unnecessary memory allocations. 2134 - In case of SOCKS5 failures, dump the socks response in the log message. 2135 - Simplify the signal setup in main(). 2136 - Streamline socks5_connect() slightly. 2137 - In socks5_connect(), require a complete socks response from the server. 2138 Previously Privoxy didn't care how much data the server response 2139 contained as long as the first two bytes contained the expected 2140 values. While at it, shrink the buffer size so Privoxy can't read 2141 more than a whole socks response. 2142 - In chat(), do not bother to generate a client request in case of 2143 direct CONNECT requests. It will not be used anyway. 2144 - Reduce server_last_modified()'s stack size. 2145 - Shorten get_http_time() by using strftime(). 2146 - Constify the known_http_methods pointers in unknown_method(). 2147 - Constify the time_formats pointers in parse_header_time(). 2148 - Constify the formerly_valid_actions pointers in action_used_to_be_valid(). 2149 - Introduce a GNUMakefile MAN_PAGE variable that defaults to privoxy.1. 2150 The Debian package uses section 8 for the man page and this 2151 should simplify the patch. 2152 - Deduplicate the INADDR_NONE definition for Solaris by moving it to jbsockets.h 2153 - In block_url(), ditch the obsolete workaround for ancient Netscape versions 2154 that supposedly couldn't properly deal with status code 403. 2155 - Remove a useless NULL pointer check in load_trustfile(). 2156 - Remove two useless NULL pointer checks in load_one_re_filterfile(). 2157 - Change url_code_map[] from an array of pointers to an array of arrays 2158 It removes an unnecessary layer of indirection and on 64bit system reduces 2159 the size of the binary a bit. 2160 - Fix various typos. Fixes taken from Debian's 29_typos.dpatch by Roland Rosenfeld. 2161 - Add a dok-tidy GNUMakefile target to clean up the messy HTML 2162 generated by the other dok targets. 2163 - GNUisms in the GNUMakefile have been removed. 2164 - Change the HTTP version in static responses to 1.1 2165 - Synced config.sub and config.guess with upstream 2166 2011-11-11/386c7218162c145f5f9e1ff7f558a3fbb66c37c5. 2167 - Add a dedicated function to parse the values of toggles. Reduces duplicated 2168 code in load_config() and provides better error handling. Invalid or missing 2169 toggle values are now a fatal error instead of being silently ignored. 2170 - Terminate HTML lines in static error messages with \n instead of \r\n. 2171 - Simplify cgi_error_unknown() a bit. 2172 - In LogPutString(), don't bother looking at pszText when not 2173 actually logging anything. 2174 - Change ssplit()'s fourth parameter from int to size_t. 2175 Fixes a clang complaint. 2176 - Add a warning that the statistics currently can't be trusted. 2177 Mention Privoxy-Log-Parser's --statistics option as 2178 an alternative for the time being. 2179 - In rfc2553_connect_to(), start setting cgi->error_message on error. 2180 - Change the expected status code returned for http://p.p/die depending 2181 on whether or not FEATURE_GRACEFUL_TERMINATION is available. 2182 - In cgi_die(), mark the client connection for closing. 2183 If the client will fetch the style sheet through another connection 2184 it gets the main thread out of the accept() state and should thus 2185 trigger the actual shutdown. 2186 - Add a proper CGI message for cgi_die(). 2187 - Don't enforce a logical line length limit in read_config_line(). 2188 - Slightly refactor server_last_modified() to remove useless gmtime*() calls. 2189 - In get_content_type(), also recognize '.jpeg' as JPEG extension. 2190 - Add '.png' to the list of recognized file extensions in get_content_type(). 2191 - In block_url(), consistently use the block reason "Request blocked by Privoxy" 2192 In two places the reason was "Request for blocked URL" which hides the 2193 fact that the request got blocked by Privoxy and isn't necessarily 2194 correct as the block may be due to tags. 2195 - In listen_loop(), reload the configuration files after accepting 2196 a new connection instead of before. 2197 Previously the first connection that arrived after a configuration 2198 change would still be handled with the old configuration. 2199 - In chat()'s receive-data loop, skip a client socket check if 2200 the socket will be written to right away anyway. This can 2201 increase the transfer speed for unfiltered content on fast 2202 network connections. 2203 - The socket timeout is used for SOCKS negotiations as well which 2204 previously couldn't timeout. 2205 - Don't keep the client connection alive if any configuration file 2206 changed since the time the connection came in. This is closer to 2207 Privoxy's behaviour before keep-alive support for client connection 2208 has been added and also less confusing in general. 2209 - Treat all Content-Type header values containing the pattern 2210 'script' as a sign of text. Reported by pribog in #3134970. 2211 2212- Action file improvements: 2213 - Moved the site-specific block pattern section below the one for the 2214 generic patterns so for requests that are matched in both, the block 2215 reason for the domain is shown which is usually more useful than showing 2216 the one for the generic pattern. 2217 - Remove -prevent-compression from the fragile alias. It's no longer 2218 used anywhere by default and isn't known to break stuff anyway. 2219 - Add a (disabled) section to block various Facebook tracking URLs. 2220 Reported by Dan Stahlke in #3421764. 2221 - Add a (disabled) section to rewrite and redirect click-tracking 2222 URLs used on news.google.com. 2223 Reported by Dan Stahlke in #3421755. 2224 - Unblock linuxcounter.net/. 2225 Reported by Dan Stahlke in #3422612. 2226 - Block 'www91.intel.com/' which is used by Omniture. 2227 Reported by Adam Piggott in #3167370. 2228 - Disable the handle-as-empty-doc-returns-ok option and mark it as deprecated. 2229 Reminded by tceverling in #2790091. 2230 - Add ".ivwbox.de/" to the "Cross-site user tracking" section. 2231 Reported by Nettozahler in #3172525. 2232 - Unblock and fast-redirect ".awin1.com/.*=http://". 2233 Reported by Adam Piggott in #3170921. 2234 - Block "b.collective-media.net/". 2235 - Widen the Debian popcon exception to "qa.debian.org/popcon". 2236 Seen in Debian's 05_default_action.dpatch by Roland Rosenfeld. 2237 - Block ".gemius.pl/" which only seems to be used for user tracking. 2238 Reported by johnd16 in #3002731. Additional input from Lee and movax. 2239 - Disable banners-by-size filters for '.thinkgeek.com/'. 2240 The filter only seems to catch pictures of the inventory. 2241 - Block requests for 'go.idmnet.bbelements.com/please/showit/'. 2242 Reported by kacperdominik in #3372959. 2243 - Unblock adainitiative.org/. 2244 - Add a fast-redirects exception for '.googleusercontent.com/.*=cache'. 2245 - Add a fast-redirects exception for webcache.googleusercontent.com/. 2246 - Unblock http://adassier.wordpress.com/ and http://adassier.files.wordpress.com/. 2247 2248- Filter file improvements: 2249 - Let the yahoo filter hide '.ads'. 2250 - Let the msn filter hide overlay ads for Facebook 'likes' in search 2251 results and elements with the id 's_notf_div'. They only seem to be 2252 used to advertise site 'enhancements'. 2253 - Let the js-events filter additionally disarm setInterval(). 2254 Suggested by dg1727 in #3423775. 2255 2256- Documentation improvements: 2257 - Clarify the effect of compiling Privoxy with zlib support. 2258 Suggested by dg1727 in #3423782. 2259 - Point out that the SourceForge messaging system works like a black 2260 hole and should thus not be used to contact individual developers. 2261 - Mention some of the problems one can experience when not explicitly 2262 configuring an IP addresses as listen address. 2263 - Explicitly mention that hostnames can be used instead of IP addresses 2264 for the listen-address, that only the first address returned will be 2265 used and what happens if the address is invalid. 2266 Requested by Calestyo in #3302213. 2267 2268- Log message improvements: 2269 - If only the server connection is kept alive, do not pretend to 2270 wait for a new client request. 2271 - Remove a superfluous log message in forget_connection(). 2272 - In chat(), properly report missing server responses as such 2273 instead of calling them empty. 2274 - In forwarded_connect(), fix a log message nobody should ever see. 2275 - Fix a log message in socks5_connect(), a failed write operation 2276 was logged as failed read operation. 2277 - Let load_one_actions_file() properly complain about a missing 2278 '{' at the beginning of the file. 2279 Simply stating that a line is invalid isn't particularly helpful. 2280 - Do not claim to listen on a socket until Privoxy actually does. 2281 Patch submitted by Petr Pisar #3354485 2282 - Prevent a duplicated LOG_LEVEL_CLF message when sending out 2283 the "no-server-data" response. 2284 - Also log the client socket when dropping a connection. 2285 - Include the destination host in the 'Request ... marked for 2286 blocking. limit-connect{...} doesn't allow CONNECT ...' message 2287 Patch submitted by Saperski in #3296250. 2288 - Prevent a duplicated log message if none of the resolved IP 2289 addresses were reachable. 2290 - In connect_to(), do not pretend to retry if forwarded-connect-retries 2291 is zero or unset. 2292 - When a specified user or group can't be found, put the name in 2293 single-quotes when logging it. 2294 - In rfc2553_connect_to(), explain getnameinfo() errors better. 2295 - Remove a useless log message in chat(). 2296 - When retrying to connect, also log the maximum number of connection 2297 attempts. 2298 - Rephrase a log message in compile_dynamic_pcrs_job_list(). 2299 Divide the error code and its meaning with a colon. Call the pcrs 2300 job dynamic and not the filter. Filters may contain dynamic and 2301 non-dynamic pcrs jobs at the same time. Only mention the name of 2302 the filter or tagger, but don't claim it's a filter when it could 2303 be a tagger. 2304 - In a fatal error message in load_one_actions_file(), cover both 2305 URL and TAG patterns. 2306 - In pcrs_strerror(), properly report unknown positive error code 2307 values as such. Previously they were handled like 0 (no error). 2308 - In compile_dynamic_pcrs_job_list(), also log the actual error code as 2309 pcrs_strerror() doesn't handle all errors reported by pcre. 2310 - Don't bother trying to continue chatting if the client didn't ask for it. 2311 Reduces log noise a bit. 2312 - Make two fatal error message in load_one_actions_file() more descriptive. 2313 - In cgi_send_user_manual(), log when rejecting a file name due to '/' or '..'. 2314 - In load_file(), log a message if opening a file failed. 2315 The CGI error message alone isn't too helpful. 2316 - In connection_destination_matches(), improve two log messages 2317 to help understand why the destinations don't match. 2318 - Rephrase a log message in serve(). Client request arrival 2319 should be differentiated from closed client connections now. 2320 - In serve(), log if a client connection isn't reused due to a 2321 configuration file change. 2322 - Let mark_server_socket_tainted() always mark the server socket tainted, 2323 just don't talk about it in cases where it has no effect. It doesn't change 2324 Privoxy's behaviour, but makes understanding the log file easier. 2325 2326- configure: 2327 - Added a --disable-ipv6-support switch for platforms where support 2328 is detected but doesn't actually work. 2329 - Do not check for the existence of strerror() and memmove() twice 2330 - Remove a useless test for setpgrp(2). Privoxy doesn't need it and 2331 it can cause problems when cross-compiling. 2332 - Rename the --disable-acl-files switch to --disable-acl-support. 2333 Since about 2001, ACL directives are specified in the standard 2334 config file. 2335 - Update the URL of the 'Removing outdated PCRE version after the 2336 next stable release' posting. The old URL stopped working after 2337 one of SF's recent site "optimizations". Reported by Han Liu. 2338 2339- Privoxy-Regression-Test: 2340 - Added --shuffle-tests option to increase the chances of detection race conditions. 2341 - Added a --local-test-file option that allows to use Privoxy-Regression-Test without Privoxy. 2342 - Added tests for missing socks4 and socks4a forwarders. 2343 - The --privoxy-address option now works with IPv6 addresses containing brackets, too. 2344 - Perform limited sanity checks for parameters that are supposed to have numerical values. 2345 - Added a --sleep-time option to specify a number of seconds to 2346 sleep between tests, defaults to 0. 2347 - Disable the range-requests tagger for tests that break if it's enabled. 2348 - Log messages use the ISO 8601 date format %Y-%m-%d. 2349 - Fix spelling in two error messages. 2350 - In the --help output, include a list of supported tests and their default levels. 2351 - Adjust the tests to properly deal with FEATURE_TOGGLE being disabled. 2352 2353- Privoxy-Log-Parser: 2354 - Perform limited sanity checks for command line parameters that 2355 are supposed to have numerical values. 2356 - Implement a --unbreak-lines-only option to try to revert MUA breakage. 2357 - Accept and highlight: Added header: Content-Encoding: deflate 2358 - Accept and highlight: Compressed content from 29258 to 8630 bytes. 2359 - Accept and highlight: Client request arrived in time on socket 21. 2360 - Highlight: Didn't receive data in time: a.fsdn.com:443 2361 - Accept log messages with ISO 8601 time stamps, too. 2362 2363- uagen: 2364 - Bump generated Firefox version to 8.0. 2365 - Only randomize the release date if the new --randomize-release-date 2366 option is enabled. Firefox versions after 4 use a fixed date string 2367 without meaning. 2368 2369*** Version 3.0.17 Stable *** 2370 2371- Fixed last-chunk-detection for responses where the body was small 2372 enough to be read with the headers, causing Privoxy to wait for the 2373 end of the content until the server closed the connection or the 2374 request timed out. Reported by "Karsten" in #3028326. 2375- Responses with status code 204 weren't properly detected as body-less 2376 like RFC2616 mandates. Like the previous bug, this caused Privoxy to 2377 wait for the end of the content until the server closed the connection 2378 or the request timed out. Fixes #3022042 and #3025553, reported by a 2379 user with no visible name. Most likely also fixes a bunch of other 2380 AJAX-related problem reports that got closed in the past due to 2381 insufficient information and lack of feedback. 2382- Fixed an ACL bug that made it impossible to build a blacklist. 2383 Usually the ACL directives are used in a whitelist, which worked 2384 as expected, but blacklisting is still useful for public proxies 2385 where one only needs to deny known abusers access. 2386- Added LOG_LEVEL_RECEIVED to log the not-yet-parsed data read from the 2387 network. This should make debugging various parsing issues a lot easier. 2388- The IPv6 code is enabled by default on Windows versions that support it. 2389 Patch submitted by oCameLo in #2942729. 2390- In mingw32 versions, the user.filter file is reachable through the 2391 GUI, just like default.filter is. Feature request 3040263. 2392- Added the configure option --enable-large-file-support to set a few 2393 defines that are required by platforms like GNU/Linux to support files 2394 larger then 2GB. Mainly interesting for users without proper logfile 2395 management. 2396- Logging with "debug 16" no longer stops at the first nul byte which is 2397 pretty useless. Non-printable characters are replaced with their hex value 2398 so the result can't span multiple lines making parsing them harder then 2399 necessary. 2400- Privoxy logs when reading an action, filter or trust file. 2401- Fixed incorrect regression test markup which caused a test in 2402 3.0.16 to fail while Privoxy itself was working correctly. 2403 While Privoxy accepts hide-referer, too, the action name is actually 2404 hide-referrer which is also the name used one the final results page, 2405 where the test expected the alias. 2406 2407- CGI interface improvements: 2408 - In finish_http_response(), continue to add the 'Connection: close' 2409 header if the client connection will not be kept alive. 2410 Anonymously pointed out in #2987454. 2411 - Apostrophes in block messages no longer cause parse errors 2412 when the blocked page is viewed with JavaScript enabled. 2413 Reported by dg1727 in #3062296. 2414 - Fix a bunch of anchors that used underscores instead of dashes. 2415 - Allow to keep the client connection alive after crunching the previous request. 2416 Already opened server connections can be kept alive, too. 2417 - In cgi_show_url_info(), don't forget to prefix URLs that only contain 2418 http:// or https:// in the path. Fixes #2975765 reported by Adam Piggott. 2419 - Show the 404 CGI page if cgi_send_user_manual() is called while 2420 local user manual delivery is disabled. 2421 2422- Action file improvements: 2423 - Enable user.filter by default. Suggested by David White in #3001830. 2424 - Block .sitestat.com/. Reported by johnd16 in #3002725. 2425 - Block .atemda.com/. Reported by johnd16 in #3002723. 2426 - Block js.adlink.net/. Reported by johnd16 in #3002720. 2427 - Block .analytics.yahoo.com/. Reported by johnd16 in #3002713. 2428 - Block sb.scorecardresearch.com, too. Reported by dg1727 in #2992652. 2429 - Fix problems noticed on Yahoo mail and news pages. 2430 - Remove the too broad yahoo section, only keeping the 2431 fast-redirects exception as discussed on ijbswa-devel@. 2432 - Don't block adesklets.sourceforge.net. Reported in #2974204. 2433 - Block chartbeat ping tracking. Reported in #2975895. 2434 - Tag CSS and image requests with cautious and medium settings, too. 2435 - Don't handle view.atdmt.com as image. It's used for click-throughs 2436 so users should be able to "go there anyway". 2437 Reported by Adam Piggott in #2975927. 2438 - Also let the refresh-tags filter remove invalid refresh tags where 2439 the 'url=' part is missing. Anonymously reported in #2986382. 2440 While at it, update the description to mention the fact that only 2441 refresh tags with refresh times above 9 seconds are covered. 2442 - javascript needs to be blocked with +handle-as-empty-document to 2443 work around Firefox bug 492459. So move .js blockers from 2444 +block{Might be a web-bug.} -handle-as-empty-document to 2445 +block{Might be a web-bug.} +handle-as-empty-document. 2446 - ijbswa-Feature Requests-3006719 - Block 160x578 Banners. 2447 - Block another omniture tracking domain. 2448 - Added a range-requests tagger. 2449 - Added two sections to get Flickr's Ajax interface working with 2450 default pre-settings. If you change the configuration to block 2451 cookies by default, you'll need additional exceptions. 2452 Reported by Mathias Homann in #3101419 and by Patrick on ijbswa-users@. 2453 2454- Documentation improvements: 2455 - Explicitly mention how to match all URLs. 2456 - Consistently recommend socks5 in the Tor FAQ entry and mention 2457 its advantage compared to socks4a. Reported by David in #2960129. 2458 - Slightly improve the explanation of why filtering may appear 2459 slower than it is. 2460 - Grammar fixes for the ACL section. 2461 - Fixed a link to the 'intercepting' entry and add another one. 2462 - Rename the 'Other' section to 'Mailing Lists' and reword it 2463 to make it clear that nobody is forced to use the trackers 2464 - Note that 'anonymously' posting on the trackers may not always 2465 be possible. 2466 - Suggest to enable debug 32768 when suspecting parsing problems. 2467 2468- Privoxy-Log-Parser improvements: 2469 - Gather statistics for ressources, methods, and HTTP versions 2470 used by the client. 2471 - Also gather statistics for blocked and redirected requests. 2472 - Provide the percentage of keep-alive offers the client accepted. 2473 - Add a --url-statistics-threshold option. 2474 - Add a --host-statistics-threshold option to also gather 2475 statistics about how many request where made per host. 2476 - Fix a bug in handle_loglevel_header() where a 'scan: ' got lost. 2477 - Add a --shorten-thread-ids option to replace the thread id with 2478 a decimal number. 2479 - Accept and ignore: Looks like we got the last chunk together 2480 with the server headers. We better stop reading. 2481 - Accept and ignore: Continue hack in da house. 2482 - Accept and higlight: Rejecting connection from 10.0.0.2. 2483 Maximum number of connections reached. 2484 - Accept and highlight: Loading actions file: /usr/local/etc/privoxy/default.action 2485 - Accept and highlight: Loading filter file: /usr/local/etc/privoxy/default.filter 2486 - Accept and highlight: Killed all-caps Host header line: HOST: bestproxydb.com 2487 - Accept and highlight: Reducing expected bytes to 0. Marking 2488 the server socket tainted after throwing 4 bytes away. 2489 - Accept: Merged multiple header lines to: 'X-FORWARDED-PROTO: http X-HOST: 127.0.0.1' 2490 2491- Code cleanups: 2492 - Remove the next member from the client_state struct. Only the main 2493 thread needs access to all client states so give it its own struct. 2494 - Garbage-collect request_contains_null_bytes(). 2495 - Ditch redundant code in unload_configfile(). 2496 - Ditch LogGetURLUnderCursor() which doesn't seem to be used anywhere. 2497 - In write_socket(), remove the write-only variable write_len in 2498 an ifdef __OS2__ block. Spotted by cppcheck. 2499 - In connect_to(), don't declare the variable 'flags' on OS/2 where 2500 it isn't used. Spotted by cppcheck. 2501 - Limit the scope of various variables. Spotted by cppcheck. 2502 - In add_to_iob(), turn an interestingly looking for loop into a 2503 boring while loop. 2504 - Code cleanup in preparation for external filters. 2505 - In listen_loop(), mention the socket on which we accepted the 2506 connection, not just the source IP address. 2507 - In write_socket(), also log the socket we're writing to. 2508 - In log_error(), assert that escaped characters get logged 2509 completely or not at all. 2510 - In log_error(), assert that ival and sval have reasonable values. 2511 There's no reason not to abort() if they don't. 2512 - Remove an incorrect cgi_error_unknown() call in a 2513 cannot-happen-situation in send_crunch_response(). 2514 - Clean up white-space in http_response definition and 2515 move the crunch_reason to the beginning. 2516 - Turn http_response.reason into an enum and rename it 2517 to http_response.crunch_reason. 2518 - Silence a 'gcc (Debian 4.3.2-1.1) 4.3.2' warning on i686 GNU/Linux. 2519 - Fix white-space in a log message in remove_chunked_transfer_coding(). 2520 While at it, add a note that the message doesn't seem to 2521 be entirely correct and should be improved later on. 2522 2523- GNUmakefile improvements: 2524 - Use $(SSH) instead of ssh, so one only needs to specify a username once. 2525 - Removed references to the action feedback thingy that hasn't been 2526 working for years. 2527 - Consistently use shell.sourceforge.net instead of shell.sf.net so 2528 one doesn't need to check server fingerprints twice. 2529 - Removed GNUisms in the webserver and webactions targets so they 2530 work with standard tar. 2531 2532*** Version 3.0.16 Stable *** 2533 2534- Added the config file option handle-as-empty-doc-returns-ok to 2535 work around Firefox bug #492459, which causes Firefox to hang 2536 if JavaScripts are blocked in certain situations. The option is 2537 enabled in the default config file. 2538- Added the config file option default-server-timeout to control the 2539 assumed default server timeout. Since Privoxy no longer returns 2540 an error message for connection resets on reused client connections, 2541 assuming larger server timeout values appears to actually work 2542 pretty well as long as connections aren't shared. 2543- Added optional support for FreeBSD's accf_http(9). Use the 2544 configure option --enable-accept-filter to enable it. 2545- Added fancier Privoxy icons for win32. Contributed by Jeff H. 2546- In daemon mode, fd 0, 1 and 2 are bound to /dev/null. 2547- Resolve localhost using whatever address family the operating 2548 system feels like. Previous betas would try to use IPv4 as this 2549 is what most users expect, but this didn't work reliably on 2550 GNU/Linux systems. 2551- In the action lists on CGI pages, actions and their parameters are 2552 no longer separated with a space. The action file parser doesn't 2553 actually allow this and will throw an invalid syntax error if actions 2554 and parameters in the action files are separated. Not adding the 2555 spaces means copy and pasting CGI output into the action files works. 2556- The default keep-alive timeout has been reduced to 5 seconds to work 2557 around hangs in clients that treat the proxy like any other host and 2558 stop allowing any new connections if the "maximum number of 2559 connections per host" is reached. 2560- Several webbug URLs that look like they are leading to images are now 2561 blocked as image instead of empty documents. Doing the latter causes 2562 WebKit-based clients to show a "missing image" icon which may mess up 2563 the layout. 2564- The no-such-domain template is used for DNS resolution 2565 problems with FEATURE_IPV6_SUPPORT enabled. Previously the 2566 connect-failed template was used. Reported by 'zebul666'. 2567- Accepts quoted expiration dates even though RFC 2109 10.1.2 2568 doesn't seem to allow them. Reported anonymously. 2569- Don't try to forget connections if connection sharing is disabled. 2570 This wasn't a real problem but caused an unnecessary log message. 2571- The still undocumented --enable-extended-host-patterns configure 2572 option has a better description. 2573- Fixed an error message that would claim a write to the server 2574 failed when actually writing to the client failed. 2575- Log the crunch reason before trying to write to the client. 2576 The log is easier to read that way. 2577- Several log messages about client connections also mention 2578 the socket number. 2579- handle-as-empty-document no longer depends on the image blocking 2580 code being enabled. 2581- Privoxy-Log-Parser is roughly 40% faster in highlighting mode. 2582- uagen, a Firefox User-Agent generator for Privoxy and Mozilla 2583 browsers has been imported and is available in the tarball's 2584 tools directory. 2585- The scripts in the tools directory treat unknown parameters 2586 as fatal errors. 2587 2588*** Version 3.0.15 beta *** 2589 2590- In case of missing server data, no error message is send to the 2591 client if the request arrived on a reused connection. The client 2592 is then supposed to silently retry the request without bothering 2593 the user. This should significantly reduce the frequency of the 2594 "No server or forwarder data received" error message many users 2595 reported. 2596- More reliable detection of prematurely closed client sockets 2597 with keep-alive enabled. 2598- FEATURE_CONNECTION_KEEP_ALIVE is decoupled from 2599 FEATURE_CONNECTION_SHARING and now available on 2600 all platforms. 2601- Improved handling of POST requests on reused connections. 2602 Should fix problems with stalled connections after submitting 2603 form data with some browser configurations. 2604- Fixed various latency calculation issues. 2605- Allows the client to pass NTLM authentication requests to a 2606 forwarding proxy. This was already assumed and hinted to work 2607 in 3.0.13 beta but actually didn't. Now it's confirmed to work 2608 with IE, Firefox and Chrome. 2609 Thanks to Francois Botha and Wan-Teh Chang 2610- Fixed a calculation problem if receiving the server headers 2611 takes more than two reads, that could cause Privoxy to terminate 2612 the connection prematurely. Reported by Oliver. 2613- Compiles again on platforms such as OpenBSD and systems 2614 using earlier glibc version that don't support AI_ADDRCONFIG. 2615 Anonymously submitted in #2872591. 2616- A bunch of MS VC project files and Suse and Redhat RPM spec 2617 files have been removed as they were no longer maintained for 2618 quite some time. 2619- Overly long action lines are properly rejected with a proper 2620 error message. Previously they would be either rejected as 2621 invalid or cause a core dump through abort(). 2622- Already timed-out connections are no longer temporarily remembered. 2623 They weren't reused anyway, but wasted a socket slot. 2624- len refers to the number of bytes actually read which might 2625 differ from the ones received. Adjust log messages accordingly. 2626- The optional JavaScript on the CGI page uses encodeURIComponent() 2627 instead of escape() which doesn't encode all characters that matter. 2628 Anonymously reported in #2832722. 2629- Fix gcc45 warnings in decompress_iob(). 2630- Various log message improvements. 2631- Privoxy-Regression-Test supports redirect tests. 2632- Privoxy-Log-Parser can gather some connection statistics. 2633 2634*** Version 3.0.14 beta *** 2635 2636- The latency is taken into account when evaluating whether or not to 2637 reuse a connection. This should significantly reduce the number of 2638 connections problems several users reported. 2639- If the server doesn't specify how long the connection stays alive, 2640 Privoxy errs on the safe side of caution and assumes it's only a second. 2641- The error pages for connection timeouts or missing server data use a 2642 Last-Modified date in the past. Retry attempts are detected and Privoxy 2643 removes the If-Modified-Since header to prevent the server from responding 2644 with status code 304 in which case the client would reuse the error message. 2645- Setting keep-alive-timeout to 0 disables keep-alive support. Previously 2646 Privoxy would claim to allow persistence but not reuse the connection. 2647- Pipelined requests are less likely to be mistaken for the request 2648 body of the previous request. Note that Privoxy still has no real 2649 pipeline support and will either serialize pipelined requests or 2650 drop them in which case the client has to resent them. 2651- Fixed a crash on some Windows versions when header randomization 2652 is enabled and the date couldn't be parsed. 2653- Privoxy's keep-alive timeout for the current connection is reduced 2654 to the one specified in the client's Keep-Alive header. 2655- For HTTP/1.1 requests, Privoxy implies keep-alive support by not 2656 setting any Connection header instead of using 'Connection: keep-alive'. 2657- If the socket isn't reusable, Privoxy doesn't temporarily waste 2658 a socket slot to remember the connection. 2659- If keep-alive support is disabled but compiled in, the client's 2660 Keep-Alive header is removed. 2661- Fixed a bug on mingw32 where downloading large files failed if 2662 keep-alive support was enabled. 2663- Fixed a bug that (at least theoretically) could cause log 2664 timestamps to be occasionally off by about a second. 2665- No Proxy-Connection header if added if there already is one. 2666- The configure script respects the $PATH variable when searching 2667 for groups and id. 2668 2669*** Version 3.0.13 beta *** 2670 2671- Added IPv6 support. Thanks to Petr Pisar who not only provided 2672 the initial patch but also helped a lot with the integration. 2673- Added client-side keep-alive support. 2674- The connection sharing code is only used if the connection-sharing 2675 option is enabled. 2676- The max-client-connections option has been added to restrict 2677 the number of client connections below a value enforced by 2678 the operating system. 2679- Fixed a regression reintroduced in 3.0.12 that could cause 2680 crashes on mingw32 if header date randomization was enabled. 2681- Compressed content with extra fields couldn't be decompressed 2682 and would get passed to the client unfiltered. This problem 2683 has only be detected through statical analysis with clang as 2684 nobody seems to be using extra fields anyway. 2685- If the server resets the Connection after sending only the headers 2686 Privoxy forwards what it got to the client. Previously Privoxy 2687 would deliver an error message instead. 2688- Error messages in case of connection timeouts use the right 2689 HTTP status code. 2690- If spawning a child to handle a request fails, the client 2691 gets an error message and Privoxy continues to listen for 2692 new requests right away. 2693- The error messages in case of server-connection timeouts or 2694 prematurely closed server connections are now template-based. 2695- If zlib support isn't compiled in, Privoxy no longer tries to 2696 filter compressed content unless explicitly asked to do so. 2697- In case of connections that are denied based on ACL directives, 2698 the memory used for the client IP is no longer leaked. 2699- Fixed another small memory leak if the client request times out 2700 while waiting for client headers other than the request line. 2701- The client socket is kept open until the server socket has 2702 been marked as unused. This should increase the chances that 2703 the still-open connection will be reused for the client's next 2704 request to the same destination. Note that this only matters 2705 if connection-sharing is enabled. 2706- A TODO list has been added to the source tarball to give potential 2707 volunteers a better idea of what the current goals are. Donations 2708 are still welcome too: https://www.privoxy.org/faq/general.html#DONATE 2709 2710*** Version 3.0.12 *** 2711 2712- The socket-timeout option now also works on platforms whose 2713 select() implementation modifies the timeout structure. 2714 Previously the timeout was triggered even if the connection 2715 didn't stall. Reported by cyberpatrol. 2716- The Connection: keep-alive code properly deals with files 2717 larger than 2GB. Previously the connection was closed too 2718 early. 2719- The content length for files above 2GB is logged correctly. 2720- The user-manual directive on the show-status page links to 2721 the documentation location specified with the directive, 2722 not to the Privoxy website. 2723- When running in daemon mode, Privoxy doesn't log anything 2724 to the console unless there are errors before the logfile 2725 has been opened. 2726- The show-status page prints warnings about invalid directives 2727 on the same line as the directives themselves. 2728- Fixed several justified (but harmless) compiler warnings, 2729 mostly on 64 bit platforms. 2730- The mingw32 version explicitly requests the default charset 2731 to prevent display problems with some fonts available on more 2732 recent Windows versions. Patch by Burberry. 2733- The mingw32 version uses the Privoxy icon in the alt-tab 2734 windows. Patch by Burberry. 2735- The timestamp and the thread id is omitted in the "Fatal error" 2736 message box on mingw32. 2737- Fixed two related mingw32-only buffer overflows. Triggering 2738 them required control over the configuration file, therefore 2739 this isn't seen as a security issue. 2740- In verbose mode, or if the new option --show-skipped-tests 2741 is used, Privoxy-Regression-Test logs skipped tests and the 2742 skip reason. 2743 2744*** Version 3.0.11 *** 2745 2746- On most platforms, outgoing connections can be kept alive and 2747 reused if the server supports it. Whether or not this improves 2748 things depends on the connection. 2749- When dropping privileges, membership in supplementary groups 2750 is given up as well. Not doing that can lead to Privoxy running 2751 with more rights than necessary and violates the principle of 2752 least privilege. Users of the --user option are advised to update. 2753 Thanks to Matthias Drochner for reporting the problem, 2754 providing the initial patch and testing the final version. 2755- Passing invalid users or groups with the --user option 2756 didn't lead to program exit. Regression introduced in 3.0.7. 2757- The match all section has been moved from default.action 2758 to a new file called match-all.action. As a result the 2759 default.action no longer needs to be touched by the user 2760 and can be safely overwritten by updates. 2761- The standard.action file has been removed. Its content 2762 is now part of the default.action file. 2763- In some situations the logged content length was slightly too low. 2764- Crunched requests are logged with their own log level. 2765 If you used "debug 1" in the past, you'll probably want 2766 to additionally enable "debug 1024", otherwise only passed 2767 requests will be logged. If you only care about crunched 2768 requests, simply replace "debug 1" with "debug 1024". 2769- The crunch reason has been moved to the beginning of the 2770 crunch message. For HTTP URLs, the protocol is logged as well. 2771- Log messages are shortened by printing the thread id on its 2772 own (as opposed to putting it inside the string "Privoxy()"). 2773- The config option socket-timeout has been added to control 2774 the time Privoxy waits for data to arrive on a socket. 2775- Support for remote toggling is controlled by the configure 2776 option --disable-toggle only. In previous versions it also 2777 depended on the action editor and thus configuring with the 2778 --disable-editor option would disable remote toggling support 2779 as well. 2780- Requests with invalid HTTP versions are rejected. 2781- The template symbol @date@ can be used to include a date(1)-like 2782 time string. Initial patch submitted by Endre Szabo. 2783- Responses from shoutcast servers are accepted again. 2784 Problem reported and fix suggested by Stefan. 2785- The hide-forwarded-for-headers action has been replaced with 2786 the change-x-forwarded-for{} action which can also be used to 2787 add X-Forwarded-For headers. The latter functionality already 2788 existed in Privoxy versions prior to 3.0.7 but has been removed 2789 as it was often used unintentionally (by not using the 2790 hide-forwarded-for-headers action). 2791- A "clear log" view option was added to the mingw32 version 2792 to clear out all of the lines in the Privoxy log window. 2793 Based on a patch submitted by T Ford. 2794- The mingw32 version uses "critical sections" now, which prevents 2795 log message corruption under load. As a side effect, the 2796 "no thread-safe PRNG" warning could be removed as well. 2797- The mingw32 version's task bar icon is crossed out and 2798 the color changed to gray if Privoxy is toggled off. 2799 2800*** Version 3.0.10 *** 2801 2802- Ordinary configuration file changes no longer cause program 2803 termination on OS/2 if the name of the logfile hasn't been 2804 changed as well. This regression probably crept in with the 2805 logging improvements in 3.0.7. Reported by Maynard. 2806- The img-reorder filter is less likely to mess up JavaScript code in 2807 img tags. Problem and solution reported by Glenn Washburn in #2014552. 2808- The source tar ball now includes Privoxy-Log-Parser, 2809 a syntax-highlighter for Privoxy logs. For fancy screenshots see: 2810 http://www.fabiankeil.de/sourcecode/privoxy-log-parser/ 2811 Documentation is available through perldoc(1). 2812 2813*** Version 3.0.9 beta *** 2814 2815- Added SOCKS5 support (with address resolution done by 2816 the SOCKS5 server). Patch provided by Eric M. Hopper. 2817- The "blocked" CGI pages include a block reason that was 2818 provided as argument to the last-applying block action. 2819- If enable-edit-actions is disabled (the default since 3.0.7 beta) 2820 the show-status page hides the edit buttons and explains why. 2821 Previously the user would get the "this feature has been disabled" 2822 message after using the edit button. 2823- Forbidden CONNECT requests are treated like blocks by default. 2824 The now-pointless treat-forbidden-connects-like-blocks action 2825 has been removed. 2826- Not enabling limit-connect now allows CONNECT requests to all ports. 2827 In previous versions it would only allow CONNECT requests to port 443. 2828 Use +limit-connect{443} if you think you need the old default behaviour. 2829- The CGI editor gets turned off after three edit requests with invalid 2830 file modification timestamps. This makes life harder for attackers 2831 who can leverage browser bugs to send fake Referers and intend to 2832 brute-force edit URLs. 2833- Action settings for multiple patterns in the same section are 2834 shared in memory. As a result these sections take up less space 2835 (and are loaded slightly faster). Problem reported by Franz Schwartau. 2836- Linear white space in HTTP headers will be normalized to single 2837 spaces before parsing the header's content, headers split across 2838 multiple lines get merged first. This should prevent problems like: 2839 * letting the session-cookies-only action slip 2840 some Cookies through unmodified, 2841 * only suppressing the first line of a header, 2842 thus creating an invalid one, and 2843 * to incorrectly block headers with valid timestamps 2844 that weren't properly recognized. 2845 Headers that could trigger these problems are unlikely to appear 2846 in "normal" web traffic, but could be intentionally generated to 2847 fool some of Privoxy's header parsers. 2848- Host information is gathered outside the main thread so it's less 2849 likely to delay other incoming connections if the host is misconfigured. 2850- New config option "hostname" to use a hostname other than 2851 the one returned by the operating system. Useful to speed-up responses 2852 for CGI requests on misconfigured systems. Requested by Max Khon. 2853- The CGI editor supports the "disable all filters of this type" 2854 directives "-client-header-filter", "-server-header-filter", 2855 "-client-header-tagger" and "-server-header-tagger". 2856- Fixed false-positives with the link-by-url filter and URLs that 2857 contain the pattern "/jump/". 2858- The less-download-windows filter no longer messes 2859 "Content-Type: application/x-shockwave-flash" headers up. 2860- In the show-url-info page's "Final results" section active and 2861 inactive actions are listed separately. Patch provided by Lee. 2862- The GNUmakefile supports the DESTDIR variable. Patch for 2863 the install target submitted by Radoslaw Zielinski. 2864- Embedding the content of configuration files in the show-status 2865 page is significantly faster now. For a largish action file (1 MB) 2866 a speedup of about 2450 times has been measured. This is mostly 2867 interesting if you are using large action files or regularly use 2868 Privoxy-Regression-Test while running Privoxy through Valgrind, 2869 for stock configuration files it doesn't really matter. 2870- If zlib support is unavailable and there are content 2871 filters active but the prevent-compression action is disabled, 2872 the show-url-info page includes a warning that compression 2873 might prevent filtering. 2874- The show-url-info page provides an OpenSearch Description that 2875 allows to access the page through browser search plugins. 2876- Custom client-header filters that rewrite the request line 2877 incorrectly no longer cause Privoxy to crash. Reported by din_a4. 2878- The obsolete kill-popups action has been removed as the 2879 PCRS-based popup filters can do the same and are slightly 2880 less unreliable. 2881- The inspect-jpegs action has been removed. 2882- The send-wafer and send-vanilla-wafer actions have been removed. 2883 They weren't particular useful and their behaviour could be emulated 2884 with add-header anyway. 2885- Privoxy-Regression-Test has been significantly improved. 2886- Most sections in the default.action file contain tests for 2887 Privoxy-Regression-Test to verify that they are working as intended. 2888- Parts of Privoxy have been refactored to increase maintainability. 2889- Building with zlib (if available) is done by default. 2890 2891*** Version 3.0.8 *** 2892 2893- Fixed a small memory leak when listen-address only specifies the port. 2894- The source tar balls now include Privoxy-Regression-Test which 2895 (upon other things) can be used to automatically detect some 2896 packaging problems. Packagers are welcome to give it a try. 2897- Reverted a change in 3.0.7 that caused path patterns to be checked 2898 even if the host pattern match already failed. While this doesn't 2899 noticeable affect the performance, it makes it less likely to run 2900 out of stack space with overly-complex path patterns the user might 2901 have added. 2902- Updated the msn, yahoo and google filters to work as advertised again. 2903- The warning message shown by the show-status CGI page is easier to 2904 understand. Previously it wasn't clear that the error message 2905 is shown below the invalid directive. (Reported by Lee) 2906- When regenerating Content-Disposition headers the more common 2907 spelling is used for the name. Previously it was written without caps. 2908- Less confusing log message if the content type isn't overwritten 2909 because force-text-type wasn't used but the old type doesn't look 2910 like content that would be filtered normally. 2911- Better log messages if the user tries to execute filters that 2912 don't exist. 2913- Treat the non-standard Request-Range headers like standard range 2914 headers and suppress them if content filtering is enabled. 2915- Prevent the log messages for CONNECT requests to unacceptable 2916 ports from printing the limit-connect argument as [null] if 2917 limit-connect hasn't been explicitly enabled. 2918- Don't disable the mingw32 log window if the logfile directive 2919 isn't used. While it was an intentional change in 3.0.7 at least 2920 one user perceived it as a regression and the same effect can 2921 be achieved by disabling all debug directives. 2922- Fixed two minor problems related to the win32 build process: a css 2923 file was not being in the installer and the trustfile comment in the 2924 config.txt referenced a nonexisting file 2925- Minor documentation fixes. 2926 2927*** Version 3.0.7 beta *** 2928 2929- Added zlib support to filter content with gzip and deflate 2930 encoding. (Patch provided by Wil Mahan) 2931- Dedicated filters and actions are used for header filtering. 2932 "filter-client-headers" and "filter-client-headers" are no longer 2933 supported, use server-header-filter{} and client-header-filter{} 2934 instead. 2935- Tags can be used to change actions based on HTTP headers. 2936- New server-header filter: less-download-windows. 2937- New client-header taggers: css-requests, image-requests, 2938 client-ip-address, http-method, allow-post, complete-url, 2939 user-agent and privoxy-control. 2940- New server-header taggers: content-type and privoxy-control. 2941- The forward-override{} action allows to change the forwarding 2942 settings through the action files, for example based on client 2943 headers like the User-Agent, or the request origin. 2944- Socks errors are no longer handled by the CGI page for 2945 DNS resolution failures. 2946- CGI pages use favicons to signal whether they are error 2947 or control pages. This is useful if you rely heavily on 2948 browser tabs. 2949- The show-url-info CGI page shows the forwarding settings. 2950- "Crunch!" log messages (used when Privoxy answers requests 2951 by itself) now also contain the reason. 2952- Allow to rewrite the request destination behind the client's back. 2953- Fix socks requests on big-endian platforms. Patch provided by Song Weijia. 2954- Fixes possible deadlocks and crashes on OpenBSD. 2955 Patch provided by Ralf Horstmann. 2956- The CGI action editor allows to edit actionfiles with previously 2957 forbidden characters like dots. 2958- New trust entries are saved with a comment that contains the 2959 trusted referring URL (Suggested by Daniel Griscom). 2960- Filter descriptions are HTML encoded automatically. 2961- New config option "split-large-forms" to work 2962 around a browser bug that caused IE6 and IE7 to ignore 2963 the Submit button on the edit-actions-for-url CGI page. 2964- New config option "allow-cgi-request-crunching" to allow 2965 requests for Privoxy's CGI pages to be blocked, redirected 2966 or (un)trusted like ordinary requests. 2967- Empty filter files no longer interrupt the filtering process 2968 prematurely and are correctly listed on the show-status CGI page. 2969- New config option "accept-intercepted-requests" to combine 2970 Privoxy with any packet filter to build an intercepting proxy 2971 for HTTP/1.1 requests (and for HTTP/1.0 requests with Host header set). 2972- fast-redirects{} catch redirects to https URLs as well. 2973- redirect{s@foo@bar@} can be used to redirect to a rewritten 2974 version of the original URL. 2975- Trap unsupported gopher proxy requests. 2976- Fixed a bug in the User Manual delivery on Windows 2977 (mingw32 only). Images now show up correctly and HTML 2978 pages are no longer padded with garbage data. 2979- Fixed several minor memory leaks, most of them discovered with Valgrind. 2980- Only unlink the pidfile if it's actually used. 2981- Retries after connection problems with forced requests 2982 aren't blocked again. 2983- On Unix SIGABRT causes a core dump as expected and is no 2984 longer treated as normal shutdown signal. 2985- The "access denied" CGI page is more descriptive and 2986 allows retries to circumvent the referrer check. 2987- Updated PCRS to handle unexpected PCRE errors properly. 2988 Fixed crashes that could occur if Privoxy was build 2989 with external PCRE versions newer than Privoxy's internal 2990 one. (Reported by Chung-chieh Shan) 2991- Fixed crashes with null bytes in PCRS replacement strings 2992 (Patch provided by Felix Gr�bert). 2993- Fixed crashes with header time randomization on mingw32. 2994- The CGI style sheet is no longer delivered if the referring 2995 page isn't a Privoxy CGI page. This prevents a JavaScript-based 2996 Privoxy detection "attack". Note that detecting Privoxy is 2997 still possible through other ways and Privoxy was never intended 2998 to be invisible anyway. 2999- Added support for AmigaOS 4, fixed build for AmigaOS 3.x. 3000- The show-url-info CGI page displays a warning if Privoxy 3001 is currently toggled off. 3002- The show-status CGI page suppresses the edit button 3003 for action files if Privoxy has no write access. 3004- Most CGI error pages react properly to HEAD requests. 3005- Requests with RFC 3253 HTTP methods (used by Subversion) 3006 are accepted. (Patch provided by Petr Kadlec) 3007- New config option "templdir" to change the location 3008 of the CGI templates to make sure customized templates 3009 aren't "updated". 3010- Better handling of "HTTP/1.1 100 Continue" responses. 3011- The background of the PNG pattern is transparent. 3012- Fixed XML syntax errors caused by banners-by-size and banners-by-url. 3013- Fixed crashes and possible action file corruptions 3014 when lines containing hashes are written through the CGI editor. 3015- Supports dynamic filters which can contain variables. 3016- Supports tags to change the actions based on client or server headers. 3017- Incorrect actions are logged before program termination. 3018- The "actionsfile" syntax in the configuration file is consistent 3019 with the rest of the configuration options and requires the 3020 whole file name. This is an incompatible change, if you use 3021 an old configuration file you might have to append ".action" 3022 to your "actionsfile" directives. 3023- With the configuration file option "enforce-blocks" the 3024 "go there anyway" mechanism can be disabled without recompiling 3025 Privoxy. 3026- More precise error messages in case of incorrect acl syntax. 3027- Logs a warning if filtering is enabled but impossible due 3028 to lack of zlib support or use of the prevent-compression action. 3029- Less noisy handling of Cookie:" and "Connection:" headers. 3030- Improved error messages in case of connection problems. 3031- Fix a command-line-parsing bug that was introduced before 3.0.5 3032 beta and caused Privoxy to treat the last argument as configuration 3033 file if no configuration file was specified. 3034- Treat unknown command line options as fatal errors instead 3035 of silently ignoring them. 3036- Use string functions with length checks more often. 3037- Don't log CONNECT requests twice. 3038- Allow to log the source address for ACL-related connection drops. 3039- Don't ignore applying filters if the server didn't 3040 specify a Content-Type. Bug reported by Amuro Namie. 3041- Rejected CONNECT requests are logged with log level info 3042 (enabled by default) and the reason for the block. 3043- New command line option "--pre-chroot-nslookup hostname" to 3044 intialize the resolver library before chroot'ing. On some systems this 3045 reduces the number of files that must be copied into the chroot tree. 3046 (Patch provided by Stephen Gildea) 3047- Fix a long-standing memory corruption bug that could cause 3048 Privoxy to overwrite a single byte in memory it didn't explicitly 3049 allocate (but that probably was allocated anyway due to bucket size). 3050- Send template-based CGI pages as HTTP/1.1 unless the client 3051 asked for HTTP/1.0. 3052- Let the first line in connection established responses 3053 end in \r\n as required by RFC1945. Reported by Bert van Leeuwen. 3054- If no log file has been specified, disable logging instead of logging 3055 to stderr. 3056- Don't block stderr when in daemon mode. 3057- Ignore missing zero-chunks when filtering chunk-encoded content. 3058 Earlier Privoxy versions would buffer and then forward the content 3059 unmodified which caused some browsers to simply show empty pages. 3060- Fix double free in cgi_edit_actions_list(). Reported by Venustech AD-LAB. 3061- The code to add X-Forwarded-For headers when the hide-forwarded-for-headers 3062 action isn't being used has been removed. 3063- Fixed trustfile feature which previously didn't work without FEATURE_TOGGLE. 3064 Reported by Lee. 3065- Minor code clean-ups, filter and action file updates. 3066 (Some of them reported by Davide Alberani, Markus Elfring, 3067 Stefan Huehner and Adam Piggott) 3068 3069*** Version 3.0.6 *** 3070 3071- New content filters: no-ping, google, msn, yahoo and blogspot. 3072- New header filters: x-httpd-php-to-html, html-to-xml, xml-to-html 3073 and hide-tor-exit-notation. 3074- The special header "X-Filter: No" now disables header filtering as well. 3075- Improved the filters img-reorder, js-annoyances, webbugs, 3076 banners-by-size, banners-by-link and ie-exploits to make them 3077 less likely to break anything. 3078- Removed outdated URL patterns in default.action and added new ones. 3079- Added redirection from http://p.p/user-manual to http://p.p/user-manual/ 3080- Changed webinterface default values for hide-user-agent, hide-referrer 3081 and set-image-blocker. 3082 3083*** Version 3.0.5 beta *** 3084 3085- Windows version can be installed/started as a service. 3086- Windows icon stays blue when Privoxy is idle, green when busy. 3087- Integrated Fabian Keil's extensive patch. See: 3088 http://www.fabiankeil.de/sourcecode/privoxy/. Includes the 3089 following new or significantly improved actions (among many 3090 other improvements): 3091 3092 content-type-overwrite{} 3093 crunch-client-header{string} 3094 crunch-if-none-match 3095 crunch-server-header{string} 3096 fast-redirects{check-decoded-url} 3097 filter-client-headers 3098 filter-server-headers 3099 force-text-mode 3100 handle-as-empty-document 3101 hide-accept-language{} 3102 hide-content-disposition{} 3103 hide-if-modified-since 3104 hide-referrer{conditional-block} 3105 overwrite-last-modified{} 3106 redirect{URL} 3107 treat-forbidden-connects-like-blocks 3108 3109- Standard-compliant clients are prevented from displaying cached 3110 copies of Privoxy's error messages after the cause of the problem 3111 has gone. 3112- Improved DNS error handling. 3113- Multiple filter files can now be specified in config. 3114- Added jpeg filtering to defend against MS jpeg vulnerability MS04-028 3115 with the new inspect-jpegs action. 3116- Removed the "arbitrary" 1000 filter limit - addresses tracker #911950 3117- Thanks to Jindrich Makovicka for a race condition fix for the log 3118 file. The race condition remains for non-pthread implementations. 3119 Reference patch #1175720. Various other logging enhancements. 3120- A pile of assorted bug fixes, memory leaks, enhancements, etc. 3121- Moved Actions file reporting mechanism to SF tracker. 3122- Two new options for config: enable-remote-http-toggle and 3123 forwarded-connect-retries. 3124- Trap unsupported FTP requests. 3125- Let text/xml be filtered. 3126- Numerous updates to default.action 3127- Increase the compiled in limit of trusted referrers from 64 to 512 3128 (for trustfile users). 3129 3130*** Version 3.0.3 *** 3131 3132- Fixed yet another two memory leaks. Process growth seems stopped now. 3133- Further tightened security against malicious toggle-off links. 3134- Excluded text/plain MIME types from filtering. This fixes a 3135 couple of client-crashing, download corruption and 3136 Privoxy performance issues, whose root cause lies in 3137 web servers labelling content of unknown type as text/plain. 3138- Assorted fixes for POSIX compliance, signal handling, graceful 3139 termination, compiler warnings, OSX support, Win32 systray, 3140 error logging, hostname wildcards, correct detection of NetBSD. 3141- Workarounds for client (iTunes etc) and server (PHP < 4.2.3) bugs 3142 including the notorious "blank page" problem. 3143- Various filter improvements; most notably the unsolicited-popups 3144 filter became less destructive 3145- Major revamp of the actions file 3146 3147*** Version 3.0.2 *** 3148 3149- Fixed two memory leaks, one serious 3150- Fixed bug in pcrs which could cause crashes with user-defined filters 3151- Fixed bug in domain name matching 3152- Assorted small fixes (Win32 menu, CGI URL editor, ..) 3153- Added basic support for the OPTIONS and TRACE http methods 3154- Added workaround for Bug in Mac OSX that made Privoxy crash occasionally 3155- Refined the default action file through >400 items of user feedback 3156- Filter changes: 3157 - Assorted refinements, optimizations and fixes in the js-annoyances, 3158 img-reorder, banners-by-size, banners-by-link, webbugs, refresh-tags, 3159 html-annoyances, content-cookies and fun filters 3160 - Replaced filter "popups" by choice between two modes: 3161 - "unsolicited-popups" tries to catch only the unsolicited ones 3162 - "all-popups" tries to kill them all (as before) 3163 - New filter "tiny-textforms" Help those tiny or hard-wrap textareas. 3164 - New filter "jumping-windows" that prevents windows from resizing 3165 and moving themselves 3166 - New filter "demoronizer" which fixes MS's abuse of std charsets 3167 (common cases anyway). 3168 - Replaced "nimda" with more general "ie-exploits" filter in which 3169 all filters for exploits shall be collected 3170- Improved cookie logging 3171- Rewrote make install target. Added uninstall and install-strip 3172 targets. 3173- Fixed a potential (application-level, NOT OS-level!) security 3174 problem involving remote toggling and action file manipulation 3175 by mailicious websites. 3176- Added ability to chroot (thanks to Sviatoslav Sviridov) 3177- Added more action aliases for prehistoric action names 3178- Add Slackware support to Makefile. 3179 3180*** Version 3.0 *** 3181 3182- Fixed Windows startmenu items, log window and tray icon menus. 3183- Added warning for bogus install target 3184- Added quicktime-kioskmode filter and improved frameset-borders 3185- Updated default.action based on latest feedback 3186- New PDF doc build process 3187- Add a user contrib module to cvs: 3188 http://cvs.sourceforge.net/cgi-bin/viewcvs.cgi/ijbswa/contrib/ 3189 3190*** Version 2.9.18 *** 3191 3192- Added workaround for IE bug that broke CGI interface 3193- Bugfix: String actions now reliably editable through CGI interface 3194- Three filters fixed (again!) 3195- Assorted small fixes and doc enhancements 3196 3197*** Version 2.9.16 *** 3198 3199- Major revamp of default.action to get rid of years of cruft. 3200- Same for default.filter 3201- Re-design and major improvements to the CGI editor interface. 3202- Address spurious 'out of memory' error due to incorrect file permissions. 3203- Impose buffer limits while reading client and server headers. 3204- Better memory and CPU optimization. 3205- Add Conectiva Linux package. 3206- user-manual directive added to config for help links from within CGI 3207 editor. 3208- Multiple actions files can now be specified in config. 3209- Actions files are changed to: default.action, standard.action, and 3210 user.action. user.action is for personal/local configuration. 3211- The usual many small and miscellaneous bug and security fixes. 3212 3213*** Version 2.9.14 beta *** 3214 3215- Fix Solaris compile problem (gateway.h and filters.h) 3216- Makefile fixes for Solaris, FreeBSD (?) 3217- Fix build failure where certain features were disabled. 3218- 'blocked-compact' template is removed. Various CGI improvements, 3219 including an adaptive 'blocked' template. 3220- Various tweaks for actions file to get ready for stable 3.0 3221- Included a 'Bookmarklet' and PHP scripts for reporting actions file 3222 problems via web interface at privoxy.org. Accessed via internal CGIs. 3223- Include cgi-style.css for templates. 3224- #include mechansim for common text in templates 3225- Various other minor fixes. 3226 3227*** Version 2.9.13 beta *** 3228 3229- *NEWS*: The project has been renamed to Privoxy! The new name is 3230 reflected throughout (file locations, etc). 3231- ijb.action is now default.action. re_filterfile is now 3232 default.filter. 3233- http://i.j.b/ is now http://p.p/ 3234- The 'logo' option for replacing ad iamges is removed now. 'Pattern' 3235 (checkerboard) is now the default. 3236- RPM spec file make over. 3237 3238 3239*** Version 2.9.12 beta *** 3240 3241- **READ**: The default listening PORT is NOW 8118!!! Changed from 3242 8000 due to conflict with NAS (Network Audio Server, whatever that 3243 is.) 3244- More CGI actions editor fixes and improvements. 3245- Win32 command line fix ups. 3246- re_filterfile now has modular sections that can be activated on a 3247 per site basis. Some new goodies there too. 3248- +filter now takes arguments to match FILTER sections in re_filterfile 3249 for even more flexibility. 3250- Added a new image blocker option: +image-blocker{pattern}, which 3251 displays a checkerboard patthern and scales better than the logo. 3252- PNG images will be used in place of GIF for JB built-in images 3253 if configured with --enable-no-gif. 3254- Clean up compiler warnings (mostly). 3255- Improved handling of failed DNS lookups & diagnostics for failed bind 3256 to listen socket 3257- Made --no-daemon mode log to tty instead of logfile. 3258- Various spec file and init script cleanups and improvements (Redhat and 3259 SuSE). 3260- CGI Editor works on OS/2 now. 3261- Fix restart failure where sockets were in TIME_WAIT. 3262- Fixes for actions cgi editor, make sure we have right file. 3263- A --pidfile command line option now, in addition to --help, 3264 --version, --no-daemon, --user and configfile. --no-daemon replaces 3265 the former -d option and _DEBUG define. --user will drop privileges 3266 to the specified user. 3267- Signal handling cleanups (*nix). 3268- CGI actions editor improvements and fixes. 3269- Error handling improvements, especially out of memory. 3270- Default re_filterfile fix that caused spurious IJB logos 3271 (instead of 'blank'). 3272- configure.in threading fixes for Solaris. 3273- Various other minor fixes. 3274 3275 3276*** Version 2.9.11 beta Changes *** 3277 3278- Add "session" cookie concept where cookies exist for the life 3279 of that browser session only (ie never goes to disk). 3280- Checks for correct header length. 3281- Fix user:pass@host.domain.com auth bug. 3282- Better signal handling on *nix. 3283- Fix CFLAGS hard-coded in configure.in 3284- Fix threading bug re: gethostbyname() that caused random 3285 URLs to fail in some cases. 3286 3287 3288*** Version 2.9.11 Alpha Changes *** 3289 3290- A web-based editor for the actions file is included (go to http://i.j.b/). 3291- Web-based toggle IJB on/off support. 3292- Cookie handling has changed - the new +no-cookies-keep feature is now the 3293default. 3294- actionsfile is renamed to ijb.action. 3295- junkbstr.txt is now config.txt on Win32. 3296- Support for running IJB as a UNIX daemon process has improved. 3297- Unix daemon now returns error code on failed start. 3298- Timestamps in logfile and jarfile now. 3299- Fix for the Netscape bug reintroduced in 2.9.9. 3300- make should now abort if gmake (GNU make) not present. 3301- Many other minor bugfixes 3302- Start a ChangeLog :) 3303 3304 3305 3306*** Version 2.9.3 pre-Alpha Changes *** 3307 3308- Amiga support (completely untested by me - I don't have an Amiga) 3309- "tinygif 3" support (redirects blocked images to a specified URL, so 3310the browser doesn't have to load and cache many copies of the same 3311image). 3312- one case where there were both local and global "referrer" variables 3313(yuck!) clarified by renaming the local one to "refer". 3314- Fixed some places where close() was used instead of close_socket(). 3315Thanks to J�rg Strohmayer (joergs at users.sourceforge.net) for these. 3316- Temporary hack to get FORCE_LOAD to work with IE. I just lowercased the 3317FORCE_LOAD_PREFIX. Needs fixing properly. 3318- Most URLs hardcoded into Junkbuster were changed to go through a script 3319e.g. http://ijbswa.sourceforge.net/redirect.php?v=2.9.3&to=faq 3320The only other URLs left are the GNU GPL: 3321 http://www.fsf.org/copyleft/gpl.html 3322and the home page: 3323 http://ijbswa.sourceforge.net/ 3324... and various URLs which will be intercepted by Junkbuster anyway. 3325TODO: Still need to do something with the URLs in Junkbuster Corp's 3326copyright/trademark notice on the bottom of the show-proxy-args page. 3327- PCRE or GNU Regex is now a #define option. 3328 3329 3330*** Version 2.9.2 pre-Alpha Changes *** 3331 3332- Andreas applied the latest version of the FORCE patch. 3333 3334 3335*** Version 2.9.1 pre-Alpha Changes *** 3336 3337- in parsers.c, fixed two #ifdef FORCE to #ifdef FORCE_LOAD 3338(BTW: I think FORCE is precise enough, since loading remote 3339data is the whole purpose of a proxy..) 3340- Set the FORCE_PREFIX (back) to 'IJB-FORCE-LOAD-'. While 'noijb.' 3341is more elegant and looks like a hostname in the URL, it doesn't 3342make clear to the inexperienced user that the proxy is bypassed. It 3343also has a higher name collision risk. 3344- Filled in the function header templates for my functions in 3345parsers.c (again). They obviously got lost in our current 3346patch war ;-) 3347- Cut the credit for the �-referrer-option from the config file, 3348that Stefan had placed there. 3349- Improved the re_filterfile 3350 3351 3352*** Version 2.9.0 pre-Alpha Changes *** 3353 3354- Now use PCRE, not GNU REGEX. I have not yet had chance to check the 3355syntax of the block/image/cookie file to ensure that they match what 3356is expected - however they seem to work. 3357- Replaced "configure" script with one generated by "autoconf". Also 3358use a header "config.h" (was ijbconfig.h in my previous release) for 3359the #defines. "config.h" is now generated with "autoheader" from 3360"acconfig.h" and "configure.in". (Note that to install you do not 3361need autoconf or autoheader - just run "./configure".) 3362To see command-line options, run "./configure --help". 3363This is my first ever autoconf script, so it has some rough edges 3364(how PCRE is handled is the roughest). 3365- Error logging code replaced with new module errlog.c, based on the 3366one from JunkbusterMT (but with the threading code removed). 3367- Most of Rodney's 0.21 and 0.21A patches applied. (Marked *). I did not 3368apply all of these, since I had already independently done conditional 3369popup file, conditional image file, and integration of popup code. 3370- ACL, Jar and trust files conditionally compiled. 3371- New source file headers. 3372- Various cosmetic changes. (But I have not consistently ordered the 3373config files - I think that's worthwhile, but it's 1am and I want to 3374get this released!) 3375- RCS tags on .h files. 3376- RCS tags are const char[] rather than const char *. (Saves 4 bytes 3377per tag ;-) 3378- VC++ project files renamed to vc_junkbuster.*. 3379- show-proxy-args now shows status of all conditionals, not just REGEX 3380- Various functions moved around. Most notably all the system-specific 3381sockets code which was spread between jcc.c, bind.c, and connect.c, 3382has been moved to "jbsockets.c". The non-system-specific code from 3383connect.c and socks4.c has been movet to "gateway.c". Also, the 3384config file loader and the global variables it writes to have been 3385moved to "loadcfg.c". (Maybe this should go into loaders.c?) 3386And candidate for the "worst filename ever" award is "miscutil.c", 3387which contains, well, miscellaneous utility functions like zalloc. 3388(Suggestions for a better name for this file are welcome!) 3389- Loaders now use a common function to read a line and skip comments, 3390and this function also stores the proxy_args. 3391- Added ./junkbuster --help (Not for Win32 GUI) 3392- Added ./junkbuster --version (Not for Win32 GUI) 3393- Win32 resources are now all marked as "U.S. English", rather than 3394being a mix of "U.S. English", "U.K. English" and "Irish English". 3395- Version number changes to 2.9.0 3396 3397 3398---------------------------------------------------------------------- 3399Copyright : Written by and Copyright (C) 2001-2021 the 3400 Privoxy team. https://www.privoxy.org/ 3401 3402 Based on the Internet Junkbuster originally written 3403 by and Copyright (C) 1997 Anonymous Coders and 3404 Junkbusters Corporation. http://www.junkbusters.com/ 3405 3406 This program is free software; you can redistribute it 3407 and/or modify it under the terms of the GNU General 3408 Public License as published by the Free Software 3409 Foundation; either version 2 of the License, or (at 3410 your option) any later version. 3411 3412 This program is distributed in the hope that it will 3413 be useful, but WITHOUT ANY WARRANTY; without even the 3414 implied warranty of MERCHANTABILITY or FITNESS FOR A 3415 PARTICULAR PURPOSE. See the GNU General Public 3416 License for more details. 3417 3418 The GNU General Public License should be included with 3419 this file. If not, you can view it at 3420 http://www.gnu.org/copyleft/gpl.html 3421 or write to the Free Software Foundation, Inc., 59 3422 Temple Place - Suite 330, Boston, MA 02111-1307, USA. 3423
