Py-nightscout

Bug fix release: the 0.12.0 release had an issue with loading the clock view javascript bundle, which was fixed in this release


**Overview**

The release focuses improving the data management and packaging of Nightscout, to both make it load faster and consume less resources on the client, but also to fix data related issues. Based on testing, the release resolves many issues related to data, such as site loading slowly or the admin section showing treatments in the future.

**READ THIS:** The Nightscout REST API now normalizes dates in the data to the UTC time zone. This might cause some data loading to behave unexpectedly for n hours after updating the site (where n is the number of hours between your local time and UTC). If you're using systems that syncronizes data both ways with Nightscout (such as a DIY artificial pancreas), please keep a close eye to how everything is behaving after you upgrade.

While installing, please sanity check the following:

* Check you have the DISPLAY_UNITS setting in Heroku or Azure, and that it's set to either _mmol_ or _mg/dl_
* In the Profile Editor, double check the profile is fully filled and matches the actual profile

**Notable new features**

* Guardian Connect now supports the EU servers (set MMCONNECT_SERVER=EU in site settings, among other parameters)

**Notable changes**

* Random metrics: 12299 new lines of code, with 6692 old lines gone
* The site now loads less data on start, with up to around 50% less data needed for people using a DIY artificial pancreas
* Related to the data loading changes, battery, cannula, sensor age now support up to 31 day old entries
* You can now log protein and fat intake for meal treatments and see the aggregate records in daily reports
* Speech: Pressing the button to enable sounds now also enables speech on mobile devices
* Guardian Connect now supports the EU servers (set MMCONNECT_SERVER=EU in site settings, among other parameters)
* Nightscout now visualizes Guardian users’ trend arrows using the one to three arrow format for consistency with Medtronic CGM systems
* REST API fixes to bugs introduced in the previous release
* Fixes an issue where the latest iOS caused a stale data alarm every time, when Nightscout had been added as a Home Screen web app
* Javascript packaging has been improved, so the site should both load faster and require less memory to run
* Layout fixes for setups with a lot of features enabled
* Glucose distribution report was showing slightly elevated variability for users with noisy CGM records
* Plugin code was improved to reduce issues when a single plugin is misbehaving
* Many dependencies were updated to newer versions with no know security issues
* Many language updates and fixes

**Developers**

* The REST API now users Moment.js to parse dates and normalize the date to UTC. If the date had a time zone defined in the object, the resulting new date will be in UTC and a new _utcOffset_ field will be added to the data, which defines the time zone delta from UTC in minutes (positive numbers indicate zones ahead of UTC)
* The clock face code was completely refactored
* ESLint is now happy with the site (and .eslintrc is committed to the repository)
* Developers should check CONTRIBUTING.md for changes in how the site is now run in dev mode and how to run the site to get automatic reload on code changes. Javascript packaging now uses the webpack dev mode along with nodemon, so when running in dev mode, all changes are deployed when you save changes in your editor. The site also runs eslint in the packaging mode; please check any reported errors and fix them before PRing changes.
* The repository now includes .eslintrc and .jsbeautifyrc files; using VSCode for editing with those plugins is recommended

Contributors to this release: sulkaharo, PieterGit, unsoluble, jasoncalabrese, jpcunningh, rob-andy, mitchellhenke, m-a-v, janrpn, OpossumGit, diabetlum, tanja3981, thecubic, jungsomyeong


- remove `+` metadata from version
- upgrade webpack to 4.29.3
- stick to `event-stream` version 3.3.4, because with 4.0.1 GitHub will issue a security warning
- for all other changes, see https://github.com/nightscout/cgm-remote-monitor/releases/tag/0.11.0

Make sure you use the released version. That can be found at
https://github.com/nightscout/cgm-remote-monitor/releases


Changes

Over 360 commits, 89 files changed, +8,428 / −6,569 lines of changes (full list of changes here:
https://github.com/nightscout/cgm-remote-monitor/pull/4022/commits )

New features
- Fully secure by default out of the box. Unsecure access via http is not allowed anymore by default. This might force you to re-authenticate with your `API_SECRET` or token if you were using unsecure access. (PieterGit )
- No outdated packages with vulnerabilities are being used anymore (PieterGit )
- Add Week to Week report (jpcunningh, https://github.com/nightscout/cgm-remote-monitor/pull/4123 )
- Add Loopalyzer report to analyse looping. Visualize your loop (lixgbg, https://github.com/nightscout/cgm-remote-monitor/pull/3629 https://github.com/nightscout/cgm-remote-monitor/pull/4235 )
- Add predictions support to Day to Day report (lixgbg, https://github.com/nightscout/cgm-remote-monitor/pull/3179 )
- Add cgm sensor stop to Careportal (jpcunningh, https://github.com/nightscout/cgm-remote-monitor/pull/4060)

Removed features
- remove `mqtt` module, because it had a security issue and was not used
- remove `sgvdata` module, because it had a security issue, added a lot of complexity and wasn't needed (PieterGit ). Replacement implementation for CSV and TSV export (sulkaharo ).

Improvements
- Fix MongoDB database insert handling. Log error on inserts and don't crash in case the MongoDB disk is full or MongoDB quota is reached (sulkaharo and jpcunningh)
- Upgrade packages to recent version, fixing all known security issues with dependencies (PieterGit)
- Redirect redirect HTTP to HTTPS and implement HSTS (jweismann, PieterGit, https://github.com/nightscout/cgm-remote-monitor/pull/4044 and https://github.com/nightscout/cgm-remote-monitor/issues/4010 and https://github.com/nightscout/cgm-remote-monitor/pull/4253 )
- Technical improvement: Migrate from `uglify-js` to `terser-webpack-plugin` (PieterGit)
- Streamlined Heroku deployment template with more descriptive text and more appropriate defaults for new users (unsoluble, https://github.com/nightscout/cgm-remote-monitor/pull/4116 )

Bug fixes
- Fix CGM voltageb battery warning level to match xDrip+ (jpcunningh, https://github.com/nightscout/cgm-remote-monitor/pull/3954 )
- Fix daylight saving and reloading bug in profile editor, (DigitalDan1, Kywalh https://github.com/nightscout/cgm-remote-monitor/pull/4029 and https://github.com/nightscout/cgm-remote-monitor/pull/4074 )
- Reduce the amount of Profile Switch treatments being loaded to fix UI slowdown and Nightscout home screen losing AAPS data from >3 hours ago, (sulkaharo, vickster1, https://github.com/nightscout/cgm-remote-monitor/issues/4055 )
- Upgrade to [share2nightscout 0.2.0](https://github.com/nightscout/share2nightscout-bridge/releases/tag/0.2.0). Prevent Nightscout server crashes in case Dexcom server does not respond (PieterGit, veryfancy)
- Fix UI so pills are updated immediately after new data is loaded (sulkaharo)
- Fixes to If-Modified-Since HTTP header handling for BG data (sulkaharo)

Documentation and language updates
- Language updates for Danish, Dutch, German, Hebrew, Norwegian, Russian
- New languages: Japanese, Turkish
- Update Alexa documentation. Note that some Alexa improvements are postponed to Nightscout 0.12 because the Alexa plugin needs refactoring, see https://github.com/nightscout/cgm-remote-monitor/issues/4168#issuecomment-451701994
- Update IFTTT maker-setup.md docs (Dave9111, unsoluble, https://github.com/nightscout/cgm-remote-monitor/pull/4206 )
- Updated various docs, including [CONTRIBUTING](https://github.com/nightscout/cgm-remote-monitor/blob/dev/CONTRIBUTING.md) documentation

Upgrade notes
- We only allow Nightscout to start with a secure Node JS.
- Latest Node 8 LTS (8.15.0 or later) and Latest Node 10 LTS (10.15.1 or later) are recommended and supported.
- Latest Node version on Azure (currently 10.14.0) is tolerated, but not recommended
- Other versions will not start
- The [rawbg](https://github.com/nightscout/cgm-remote-monitor#rawbg-raw-bg) settings are converted to a single setting tri-state variable.
- We improved security and added several new environment variables such as [INSECURE_USE_HTTP and SECURE_HSTS_HEADER](https://github.com/nightscout/cgm-remote-monitor/#predefined-values-for-your-server-settings-optional)
- Your site redirects to https by default. If you don't want that or use a Nginx or Apache proxy, set `INSECURE_USE_HTTP` to `true`.
- We enabled [HTTP Strict Transport Security (HSTS)](https://en.wikipedia.org/wiki/HTTP_Strict_Transport_Security) headers by default, settings `SECURE_HSTS_HEADER` and `SECURE_HSTS_HEADER_*`

Upgrade notes for Azure users

We recommend Azure users consider migrating their hosting to Heroku, as we've observed Heroku users have significantly less issues with having their sites work reliably. If you want to continue using Azure, change the following configuration variables in Azure before updating to the latest Nightscout version:

WEBSITE_NODE_DEFAULT_VERSION=10.14.1
SCM_COMMAND_IDLE_TIMEOUT=300


Install instructions

Install instructions can be found: https://github.com/nightscout/cgm-remote-monitor/blob/master/README.md#install

Contributors to this release

The release coordination for this release was done by PieterGit
We would like to thank the following people for their contribution (in alphabetical order):
anderser, apanasef, balshor, bewest, blocklist_twitter, CaroGo, cascer1, cluckj, danamlewis, Dave9111, diabetlum, herzogmedia, janrpn, jasoncalabrese, jpcunningh, jweismann, kenstack, Kywalh, lixgbg, LuminaryXion, MilosKozak, mitrei, PaperT1D, PieterGit, unsoluble, rarneson, renegadeandy, scottleibrand, sulkaharo, T-o-b-i-a-s, tynbendad, unsoluble, veryfancy, viq, wootmasterslick

(if I forgot somebody, please respond)

TODO for next release

TODO: Translations, Languages with less than 80% will be removed in a future Nightscout version. Currently the following languages are at risk:
中文（繁體） (zh_tw), Hrvatski (hr), Ελληνικά (el), 한국어 (ko)
See https://gitter.im/nightscout/public?at=5bef2f34de42d46bba766f66

This is a bug fix release to so the web visualizatio loads on iOS 9 and older

- New feature: `speech` plugin added. Speech synthesis plugin. When enabled, speaks out the blood glucose values, IOB and alarms.
- New feature: `xdrip-js` plugin added. Integrated xDrip-js monitoring
- Nightscout now deals with mLab and other Mongo database outages better and shouldn't need a restart after an outage
- Nightscout web page loading is now more robust for people using Loop, OpenAPS, AndroidAPS or multiple uploaders
- Site navigation now links to multiple clock views
- Client color themes now has a new 'colorblindfriendly' scheme that works better for users with deuteranopia (and possible other forms of color blindness)
- Careportal. Add support for temp targets in mmol/l
- New plugin to track pump battery age (batteryage) has been added

Other Changes & Bugfixes

- Over 250 commits, 118 files changed, +13,734 / −7,169 lines of changes (full list of changes here: https://github.com/nightscout/cgm-remote-monitor/pull/3704/commits )
- Only locales that have language support are loaded as Moment.js locales, reducing the size of the javascript bundle
- upgrade to Node 8.11.x LTS. Use of Node 9 or Node 10 is not recommended
- upgrade to Npm 5.6.x or later. Npm 6.1.x is recommended. No support for Npm 5.x (x<4)
- upgrade a lot of upgrades to dependencies, including security fixes
- `forever` has been removed for Heroku startup with the `Procfile`
- upgrade mongodb client and support MongoDB 4.x
- README updated, especially Windows instructions
- Glucose variability report now works correctly with hourly filters and sorting
- activity data storage API has been added (but no visualization for the data yet, scheduled for a later release)
- `PUMP_WARNONSUSPEND` renamed to `PUMP_WARN_ON_SUSPEND`. Set to `true` to get an alarm when the pump is suspended.
- `DEVICESTATUS_ADVANCED` (`true`) - Now defaults to true. Users who only have a single device uploading data to Nightscout can set this to false to reduce the data use of the site.
- swagger and OPEN API restored, see `/swagger.yaml` or `/swagger.json`
- most language localizations have been improved but still need work! Please join the Nightscout Translators group for details on how to help!
- Updated docs for alexa plugin
- Careportal: add Pump Battery Change event
- TDD average on daytoday report (total daily dosage)

We recommend Azure users consider migrating their hosting to Heroku, as we've observed Heroku users have significantly less issues with having their sites work reliably. If you want to continue using Azure, *change the following configuration variables in Azure before updating* to the latest Nightscout version:

WEBSITE_NODE_DEFAULT_VERSION=8.11.1
SCM_COMMAND_IDLE_TIMEOUT=300

Install instructions can be found: https://github.com/nightscout/cgm-remote-monitor/blob/master/README.md#install

The release coordination for this release was done by PieterGit and sulkaharo.
We would like to thank the following people for their contribution (in alphabetical order): 2flea, aaronjknox, AdrianLxM, apanasef, bogdangorescu, brutevinch, Dave2526, dbeasy, dideldum, dm61, dougboss, h2oil, HenrikHL, herzogmedia, hichameyessou, hummelstrand, jaylagorio, jasoncalabrese, jimrandomh, John Weston, jpcunningh, Kdisimone, kretch, lsandini, mdomox, MilosKozak, mpangburn, norbertgaal, pedrojparedes, PieterGit, PoweRGbg, rhdtv2002, ScheddyD, schmitzn, scottleibrand, someoneAnyone, sulkaharo, tanja3981, Tornado-Tim, unsoluble, veryfancy, whooze, winni67.