Pytroll-collectors

-------------------
- Update changelog. [Panu Lahtinen]
- Bump version: 0.4.0 → 0.5.0. [Panu Lahtinen]
- Fix crop tuple. [Panu Lahtinen]
- Fix cropping. [Panu Lahtinen]
- Add UID and URI to sent message. [Panu Lahtinen]
- Compose topic. [Panu Lahtinen]
- Log sent message. [Panu Lahtinen]
- Fix format. [Panu Lahtinen]
- PEP8. [Panu Lahtinen]
- Fix publisher name. [Panu Lahtinen]
- Add message settings. [Panu Lahtinen]
- Add message sending for saved global mosaics. [Panu Lahtinen]
- Add function for sending messages. [Panu Lahtinen]
- Merge branch 'develop' of https://github.com/pytroll/pytroll-
collectors into develop. [Panu Lahtinen]
- Merge pull request 3 from pytroll/feature-check-local-files. [Panu
Lahtinen]

Check presence of local files when a new slot is initialised in segment-gatherer
- Update timeout when checking segments on disk. [Martin Raspaud]
- Fix setup.cfg to require python-pillow. [Martin Raspaud]
- Add checking for locally received files in segment gatherer. [Martin
Raspaud]
- Move crop area adjustment inside None check. [Panu Lahtinen]
- Delete image object after it is not used anymore. [Panu Lahtinen]
- Add option for garbage collection to config example. [Panu Lahtinen]
- Add optional garbage collection to image scaler. [Panu Lahtinen]
- Pass logger to create_world_composite and add log messages. [Panu
Lahtinen]
- Clarify log messages. [Panu Lahtinen]
- Fix logger call. [Panu Lahtinen]
- Force garbage collection after each handled message. [Panu Lahtinen]

-------------------
- Update changelog. [Panu Lahtinen]
- Bump version: 0.3.0 → 0.4.0. [Panu Lahtinen]
- Use self.time_name when checking for existing files. [Panu Lahtinen]
- Add log message with check pattern. [Panu Lahtinen]
- Set composite as wildcard when searching for existing files. [Panu
Lahtinen]
- PEP8 logging syntax. [Panu Lahtinen]
- Handle missing 'tags' [Panu Lahtinen]
- Add return which was missing. [Panu Lahtinen]
- Convert read TIFF image to PIL image object. [Panu Lahtinen]
- Use mpop.imageo.formats.tifffile.imread() to read TIFF images. [Panu
Lahtinen]
- Move call to _tidy_platform_name() to correct place. [Panu Lahtinen]
- Add missing parameter name. [Panu Lahtinen]
- Set execute bit. [Panu Lahtinen]
- Merge pull request 2 from pytroll/feature_scale_image. [Panu
Lahtinen]

Feature scale image
- Fix updating existing image, split parts to new functions. [Panu
Lahtinen]

- use the mode of the new image
- fix masking
- use fill_value to create values for new alpha channel for the old image
if mode changes from L to LA or from L or RGB to RGBA
- add enough channels if the existing image had fewer than the new one
- remove "obsolete" channels if channel number is reduced

- Test all combinations of updating L, LA, RGB and RGBA images. [Panu
Lahtinen]
- Fix updating existing image. [Panu Lahtinen]

- use the mode of the new image
- fix masking
- add enough channels if the existing image had fewer than the new one
- use fill_value to create values for new alpha channel if mode changes
from L to LA or from L or RGB to RGBA

- Enhance test_update_existing_image. [Panu Lahtinen]
- Fix and adjust many things. [Panu Lahtinen]

- fix image updating
- change static_image_fname to static_image_fname_pattern
- use tuples as fill_value
- fix filename composing
- fix reading fill_value, compression and blocksize from config

- Use assertIsNone(), fix fill_values. [Panu Lahtinen]
- Adjust static image option name, fix default of fill_value. [Panu
Lahtinen]
- Add checks for area definition availability. [Panu Lahtinen]
- Add new config options. [Panu Lahtinen]
- Fix time_name handling, expose more settings, fix saving. [Panu
Lahtinen]

- add save settings
- find the correct name for the "nominal time"
- adjust in_pattern and out_pattern to use the same time_name as incoming
message
- use save_image instead of direct img.save()

- Add check for GSHHS_DATA_ROOT environment variable. [Panu Lahtinen]
- Add pycoast as requirement. [Panu Lahtinen]
- Install pycoast. [Panu Lahtinen]
- Remove obsolete config, add TODO. [Panu Lahtinen]
- Install Pillow and trollsift. [Panu Lahtinen]
- Add example config for scale_images.py. [Panu Lahtinen]
- Copy image before modifying, catch AttributeError when reading fonts.
[Panu Lahtinen]
- Fix looping in save_images, don't join out_dir and out_pattern when
reading config, fix _check_existing() [Panu Lahtinen]
- Fix filenames, parse from basename, more tests for ImageScaler class.
[Panu Lahtinen]
- Import test_image_scaler. [Panu Lahtinen]
- Fix out_patterns. [Panu Lahtinen]
- Add an empty image for testing ImageScaler. [Panu Lahtinen]
- Change file patterns and areaname. [Panu Lahtinen]
- Require postroll 1.3.0 or later. [Panu Lahtinen]
- Fix existing_fname_parts, fix listener queue name, fix in_pattern.
[Panu Lahtinen]
- Add more test requirements. [Panu Lahtinen]
- Add tests for ImageScaler class. [Panu Lahtinen]
- Add another section for testing crops/sizes/tags. [Panu Lahtinen]
- Add better filename patterns. [Panu Lahtinen]
- Remove unnecessary self.subject arguments, adjust raised errors. [Panu
Lahtinen]
- Move public methods before privates. [Panu Lahtinen]
- Add section for testing ImageScaler class. [Panu Lahtinen]
- Fix _get_bool(), fix config item names. [Panu Lahtinen]
- Add a function to get config value with a default value as backup.
[Panu Lahtinen]
- Remove unused comment. [Panu Lahtinen]
- Update TODO. [Panu Lahtinen]
- Change text_location to differenve value as default. [Panu Lahtinen]
- Read defaults from the module. [Panu Lahtinen]
- Change values so that they are not the same as defaults. [Panu
Lahtinen]
- Continue refactoring. [Panu Lahtinen]

- add default values for config items in a dict
- remove many try-excepts
- handle mandatory config items in a method
- move parsing of crops, sizes and tags to methods
- rename "use_platform_name_hack" to "tidy_platform_name" and make it a method
- use default dictionary for _get_text_settings()
- replace config.getint() with int(config.get())
- replace config.getbool() with own method

- Fix "font" to "font_name" [Panu Lahtinen]
- Add tests for read_image() and update_existing_image() [Panu Lahtinen]
- Use copies of the images, add tests for add_image_as_overlay. [Panu
Lahtinen]
- Check overlay validitu, raise ValueError for invalid, handle error.
[Panu Lahtinen]
- Add tests for adjust_img_mode_for_text(), add placeholder tests for
untested functions. [Panu Lahtinen]
- Fix test name, fix correct value. [Panu Lahtinen]
- Add more tests for different text/bg color settings. [Panu Lahtinen]
- Shorten lines. [Panu Lahtinen]
- Convert to RGB(A) only if text color dictates so. [Panu Lahtinen]
- Remove unnecessary if-elses, as bg_extra_width defaults to 0 not None.
[Panu Lahtinen]
- Add tests for text and background color box locations. [Panu Lahtinen]
- Move text location calculation to separate functions. [Panu Lahtinen]
- Add test for _is_rgb_color. [Panu Lahtinen]
- Add a function to convert image mode suitable for the text. [Panu
Lahtinen]
- Add test for _get_font() [Panu Lahtinen]
- Make a function to get font. [Panu Lahtinen]
- Add config parser and tests for _get_text_settings() and _add_text()
[Panu Lahtinen]
- Change default value from None to 0. [Panu Lahtinen]
- Add config file with text related test settings. [Panu Lahtinen]
- Add static font that can be used in tests. [Panu Lahtinen]
- Move saving of staticly named images to a function. [Panu Lahtinen]
- Rename latest_composite_image to static_image_fname. [Panu Lahtinen]
- Remove exception handling, add filename as kwarg to
self._update_existing_img() [Panu Lahtinen]
- Add text based on the image type, use single save command. [Panu
Lahtinen]
- Add interface funtion self._add_text() to add_text() [Panu Lahtinen]
- Move updating of existing image to self._update_existing_img() [Panu
Lahtinen]
- Add unit tests for resize_image() [Panu Lahtinen]
- Move image resizing to a separate function. [Panu Lahtinen]
- Add tests for crop_image() [Panu Lahtinen]
- Check crop limits, fix name of the returned image. [Panu Lahtinen]
- Move image crop to a separate function. [Panu Lahtinen]
- Add tests for save_image() [Panu Lahtinen]
- Convert only to GeoImage if adef and time_slot are given. [Panu
Lahtinen]
- Add first unittests for those functions that are more or less
finalized. [Panu Lahtinen]
- Refactor. [Panu Lahtinen]

- move config items to class attributes
- split run() to several smaller functions

- Move shape file environment variable to image_scaler.py. [Panu
Lahtinen]
- Add tests for image_scaler. [Panu Lahtinen]
- Move functionality to pytroll_collectors.image_scaler. [Panu Lahtinen]
- Initial commit for the library part of scale_images. [Panu Lahtinen]
- Initial version of image scaler. [Panu Lahtinen]
- Merge pull request 1 from TAlonglong/develop. [Panu Lahtinen]

bin/cat.py if publish_topic is given in config, replace topic
- Bin/segment_gatherer.py remove diff newline. [Trygve Aspenes]
- Bin/segment_gatherer.py Go back to similar handleing as original.
[Trygve Aspenes]
- Bin/segment_gatherer.py dont need the msg handeling here as it is
already done. [Trygve Aspenes]
- Fixed conflict. [Trygve Aspenes]
- Bin/segment_gatherer.py fixed _init... and process to avoid
overwriting end_time with data parsed anew from filename. [Trygve
Aspenes]
- Bin/cat.py if publish_topic is given in config, replace topic. [Trygve
Aspenes]

-------------------
- Update changelog. [Panu Lahtinen]
- Bump version: 0.2.0 → 0.3.0. [Panu Lahtinen]
- Merge branch 'develop' of https://github.com/pytroll/pytroll-
collectors into develop. [Panu Lahtinen]
- Make sure that end_time > start_time. [Martin Raspaud]
- Take preference on data in message over what's parsed from the
filename. [Panu Lahtinen]

Fixes eg. end time for EARS/VIIRS data

- Fix syntax error. [Panu Lahtinen]
- Make sure that the sensor names are in an iterable. [Panu Lahtinen]
- Add try-except around deletion of unnecessary tags. [Panu Lahtinen]
- Use full pattern, not EPI specific. [Panu Lahtinen]
- Remove confusing - and unusable - config files. [Panu Lahtinen]
- Add examples for different Metop Level-0 files. [Panu Lahtinen]
- Add example for collecting HRPT L0 files for AAPP. [Panu Lahtinen]
- Add a possibility to have a time range for files belonging to the same
time slot. [Panu Lahtinen]
- Collect all instruments, not only the one in latest received message.
[Panu Lahtinen]

-------------------
- Update changelog. [Panu Lahtinen]
- Bump version: 0.1.1 → 0.2.0. [Panu Lahtinen]
- Add check for listener's output queue name. [Panu Lahtinen]

-------------------

Fix
~~~
- Bugfix: granule metadata is now copied and not shared amoung
collectors. [Martin Raspaud]
- Bugfix: process instead of process_message. [Adam.Dybbroe]

Other
~~~~~
- Update changelog. [Panu Lahtinen]
- Bump version: 0.1.0 → 0.1.1. [Panu Lahtinen]
- Fix typo in import. [Panu Lahtinen]
- Fix listener's queue name. [Panu Lahtinen]
- Try to use miniconda. [Panu Lahtinen]
- Adjust scipy pip install command. [Panu Lahtinen]
- Add scipy as test requirement. [Panu Lahtinen]
- Use pip instead of apt-get for installing scipy. [Panu Lahtinen]
- Add pykdtree as install requirement. [Panu Lahtinen]
- Fix URLs. [Panu Lahtinen]
- Try testing with "python setup.py test" instead of coverage. [Panu
Lahtinen]
- Add watchdog as install and test requirement. [Panu Lahtinen]
- Add required packages also for tests_require list. [Panu Lahtinen]
- Python 2.6 compatibility, autopep8. [Panu Lahtinen]
- Fix coverage command. [Panu Lahtinen]
- Fix coverage command. [Panu Lahtinen]
- Moved from trollduction.producer. [Panu Lahtinen]
- Add a note about helper functions. [Panu Lahtinen]
- Initial commit. [Panu Lahtinen]
- Move/copy from trollduction. [Panu Lahtinen]
- Initial commit. [Panu Lahtinen]
- Initial commit. [Panu Lahtinen]
- Adjust imports to pytroll-collectors. [Panu Lahtinen]
- Copy needed functions from trollduction to remove dependency. [Panu
Lahtinen]
- Add execute bit. [Panu Lahtinen]
- Remove duplicates. [Panu Lahtinen]
- Merge branch 'feature_reorganize' [Panu Lahtinen]
- Move files to proper places. [Panu Lahtinen]
- Collect files for pytroll-collectors. [Panu Lahtinen]
- Add emacs temp files. [Panu Lahtinen]
- Merge branch 'master' of https://github.com/pytroll/pytroll-
collectors. [Panu Lahtinen]
- Initial commit. [Panu Lahtinen]
- Pep8. [Adam.Dybbroe]
- Add the min_length config option for catter. [Martin Raspaud]
- Add missing colon. [Panu Lahtinen]
- Prevent "ValueError: max() arg is an empty sequence" for equal sets,
add more information on logging these occurences. [Panu Lahtinen]
- Fix intendation error. [Panu Lahtinen]
- Add a function that checks swath completeness, clearer log messages.
[Panu Lahtinen]
- Bug in region collector printout. [Martin Raspaud]
- Change timeout in gatherer when last granule is not arriving last.
[Martin Raspaud]
- Merge branch 'develop' of https://github.com/mraspaud/trollduction
into develop. [Panu Lahtinen]

Conflicts:
trollduction/collectors/trigger.py
trollduction/producer.py

- Bugfix. publish_topic added as a keyword argument to WatchDogTrigger.
[Adam.Dybbroe]
- Merge branch 'develop' into my-new-aapp-runner. [Adam.Dybbroe]

Conflicts:
trollduction/collectors/trigger.py
- Bugfix. [Adam.Dybbroe]
- Merge branch 'feature-trollstalker2' into my-new-aapp-runner.
[Adam.Dybbroe]

Conflicts:
trollduction/collectors/trigger.py

- Make sure that l2processor doesn't hang on crash. [Panu Lahtinen]
- Fixed incorrect function names in PostTrollTrigger. [Panu Lahtinen]
- Merge branch 'feature-trollstalker2' into develop. [Adam.Dybbroe]

Conflicts:
trollduction/collectors/trigger.py
- Merge branch 'develop' into feature-trollstalker2. [Adam.Dybbroe]

Conflicts:
trollduction/collectors/trigger.py
- First iteration of the trollstalker rewrite. [Martin Raspaud]
- Merge branch 'feature_area_msg' into develop. [Panu Lahtinen]

Conflicts:
trollduction/collectors/region_collector.py
trollduction/producer.py
trollduction/xml_read.py

- Fixes for logging (PEP8) [Panu Lahtinen]
- For inbound messages where type is collection, check if the area
matches to the configured area. Also some cleanup for PEP8. [Panu
Lahtinen]
- Making landscape happier. [Panu Lahtinen]
- Config option "publish_topic" for setting custom topic for published
messages by gatherer. [Panu Lahtinen]
- Replace the corner estimation in region_collector with trollsched's
routines. [Martin Raspaud]
- Try bug fixing debug printout... [Adam Dybbroe]
- Gatherer: add the possibility to choose which observer is being used.
[Martin Raspaud]
- Fix multiple Thread inheritance. [Martin Raspaud]
- Mock out entire watchdogtrigger on importerror. [Martin Raspaud]
- Mock watchdog if not present. [Martin Raspaud]
- Catch importerrors when watchdog is imported. [Martin Raspaud]
- Add the collector __init__.py. [Martin Raspaud]
- Move gatherer to bin. [Martin Raspaud]
- Fix gatherer and regioncollector for new metadata and npp granules.
[Martin Raspaud]
- Add PostTrollTrigger to triggers. [Martin Raspaud]
- Logging and argparsing in catter. [Martin Raspaud]
- Remove hardcoded link to configuration files. [Martin Raspaud]
- Granule handling, first commit. [Martin Raspaud]

* Region collection is implemented.
* catter cats the low level data.