Flickr-uploader

Fixes/Features
- Added feature to allow convert RAW files into JPG for loading.
- Setup CONVERT_RAW_FILES to **True** on `uploadr.ini` configuration file.
- Uses external tool: [exiftool by Phil Harvey](https://sno.phy.queensu.ca/~phil/exiftool/).
- Dry run option (-n) also works wit convert RAW files.
- Setup (**optional**):
- You can run install with `python3 setup.py install --prefix=~/apps/Python`
- From v2.7.6 `uploadr.ini` configuration is searched from:
- `--config-file` argument
- from the sys.argv[0] path (compatible with previous versions)

Questions & Answers
- **Note that uploadr.ini definition for path search** of DB_PATH, LOCK_PATH, TOKEN_CACHE and TOKEN_PATH still uses sys.argv[0] location as a basis.
- (to be) Updated installation notes on Readme.

Output Messages
- Small adjustments on output messages.

Environment and Coding
- Python 2.7 + 3.6 compatibility: use of " noqa" as applicable
- autopep8, PEP8, flakes adjustments
- pytest --flakes & pytest --doctest-modules
- Runs several unittests
- Created setup.py (**optional use**)

Fixes/Features
- For locking on Windows: portalocker (when available) for added compatibility (For Windows support). Use fcntl otherwise (thanks belidzs and others!!)
- Fix for 56 (3 attempts to load file with exception "038".... aborts!)
- Setup (**optional**):
- You can run install with `python3 setup.py install --prefix=~/apps/Python`
- From v2.7.6 `uploadr.ini` configuration is searched from:
- `--config-file` argument
- from the sys.argv[0] path (compatible with previsous versions)

Questions & Answers
- **Note that uploadr.ini definition for path search** of DB_PATH, LOCK_PATH, TOKEN_CACHE and TOKEN_PATH still uses sys.argv[0] location as a basis.
- (to be) Updated installation notes on Readme.

Output Messages
- Small adjustments on output messages.

Environment and Coding
- Python 2.7 + 3.6 compatibility: use of " noqa" as applicable
- autopep8, PEP8, flakes adjustments
- pytest --flakes & pytest --doctest-modules
- Runs several unittests
- Created setup.py (**optional use**)

Fixes/Features
- Enhancement 7 apply further control on INI parameters. New configuration mechanism. Default values are included in the app. Ignores wrong values in INI file. Except for *api_key* and *secret* which you have to adjust, all others are preset.
- Enhancement 28 Revise upload sequence.
- More clear output messages on execution progress.
- Setup (**optional**):
- You can run install with `python3 setup.py install --prefix=~/apps/Python`
- From v2.7.6 `uploadr.ini` configuration is searched from:
- `--config-file` argument
- from the sys.argv[0] path (compatible with previsous versions)

Questions & Answers
- **Note that uploadr.ini definition for path search** of DB_PATH, LOCK_PATH, TOKEN_CACHE and TOKEN_PATH still uses sys.argv[0] location as a basis.
- (to be) Updated installation notes on Readme.

Output Messages
- More clear output messages on excution progress.

Environment and Coding
- Python 2.7 + 3.6 compatibility: use of " noqa" as applicable
- autopep8, PEP8, flakes adjustments
- pytest --flakes & pytest --doctest-modules
- Runs several unittests
- Created setup.py (**optional**)

Fixes/Features
- I'm including a distribution tarball flickr-uploader-2.7.3.tar.gz for faster/easier download with the essential files and no test related files. The full; source code is still available of course!
- From v2.7.0 onwards, uploadr adds to Flickr an album tag to each pic. uploadr v2.7.0 will automatically update the previously loaded pics with such album tag, upon first run.
- Version 2.7.1, 2.7.2 and 2.7.3 run in multiprocessing mode (use option -p) to add album tag. It limits function calls to flickr to 5 per second to avoid reaching the 3600 requests/hour of Flickr.
- New option: --add-albums-migrate is *only* available to re-run assigning album tags to previously uploaded pics, should it be necessary and in case the automated process fails.
- **PLEASE NOTE FOR LARGE LIBRARIES THIS 1st RUN:**
- **MAY TAKE A WHILE. IN MY CASE ABOUT 10min FOR EACH 1000 PICS OR SO...**
- **MAY SURPASS THE Flickr 3600 requests/hour LIMIT. SIMPLY RESTART AFTER SOME TIME & UNTIL COMPLETION**
- Confirmed resolution of issue 28
- 45 Delete/Upload to be able to replace Videos on Flickr

Questions & Answers
- Updated installation notes on Readme.
- Readme includes master test result status (from travisCI)

Output Messages
- Removed (some) multiprocessing messages from verbose

Environment and Coding
- Python 2.7 + 3.6 compatibility: use of " nova" as applicable
- autopep8, PEP8, flakes adjustments (thank you cpb8010 for your sugestions)
- pytest --flakes & pytest --doctest-modules
- Reorganized order of Init message and import.
- Moved sections from file (uploadr.py) into CONTRIBUTING, TODO, README
- Included LICENSE.txt
- Version number defined in lib/__version__.py
- Created classes lib/niceprint.py, lib/UPLDRConstants.py, lib/rate_limited.py
- Setup several unittests
- Created setup.py (in trial)
- Addressed 23 (split into modules)

Fixes/Features
- New option (--list-bad-files)to list badfiles recorded no the Database (feature 27)
- Include Album as a PIC tag. To facilitate finding failed load pics (feature 29).
- From v2.7.0 onwards, uploadr adds to Flickr an album tag to each pic. uploadr v2.7.0 will automatically update the previously loaded pics with such album tag, upon first run.
- Version 2.7.1 runs in multiprocessing mode (use option -p) to add album tag. It limits function calls to flickr to 5 per second to avoid reaching the 3600 requests/hour of Flickr.
- New option: --add-albums-migrate is *only* available to re-run assigning album tags to previously uploaded pics, should it be necessary and in case the automated process fails.
- **PLEASE NOTE FOR LARGE LIBRARIES THIS 1st RUN:**
- **MAY TAKE A WHILE. IN MY CASE ABOUT 10min FOR EACH 1000 PICS OR SO...**
- **MAY SURPASS THE Flickr 3600 requests/hour LIMIT. SIMPLY RESTART AFTER SOME TIME & UNTIL COMPLETION**
- Updated uploadr.cron file with more details. Adapt the previous file you currently already have working on your system.
- Handle orphanated PICs previously loaded without a Set.
- Register on badfiles also files to large reported by Flickrt on upload (feature 37).
- Reduce file system scannig time by not checking a file in an excluded folder (feature 36. Thanks malys).
- To confirm full resolution on: Revise try/except on upload around except error '040' (issue 28).

Questions & Answers
- Added several clarifications to Readme and Q&A section (issue 31 and 38. Thanks ze6killer).

Output Messages
- Display current vs total number of files processed.
- Adjusted niceprint of multiprocessing messages to apply only with verbose option.

Environment and Coding
- Python 2.7 + 3.6 compatibility.
- Python 3.7-dev: Initial tests only.
- Imports module xml.etree.ElementTree in case is required to use function 'xml.etree.ElementTree.tostring' (feature 41)
- Helper class rate_limited and functions to rate limiting function calls with Python Decorators on external module (V2.7.1).
- Use flickrapi 2.4 on TravisCI tests (V2.7.1)
- Reorganized order of Init message and import.
- Reordered sys.exit codes.
- Additional protection on LOGGING_LEVEL definition.
- Function is_photo_already_uploaded: one additional result for PHOTO UPLOADED WITHOUT SET WITH ALBUM TAG when row exists on DB. Mark such row on the database files.set_id to null to force re-assigning to Album/Set on flickr.
- Addresses deleted file from local which is also deleted from flickr
- Created function getSetNameFromFile (V2.7.0)
- Adapted niceprint to print function name on new optional parameter (V2.7.0).
- Enhanced is_photo_already_uploaded function (V2.7.0).

Fixes/Features
- Include Album as a PIC tag. to facilitate finding failed load pics (feature 29).
- From v2.7.0 onwards, uploadr adds to Flickr an album tag to each pic. uploadr v2.7.0 will automatically update the previously loaded pics with such album tag, upon first run.
- **PLEASE NOTE FOR LARGE LIBRARIES THIS 1st RUN MAY TAKE A WHILE. IN MY CASE ABOUT 10min FOR EACH 1000 PICS OR SO...**
- **AFTER A FEW HOURS RUNNING I'm getting "flickrapi.exceptions.FlickrError: Error: 0: Sorry, the Flickr API service is not currently available." from FLICKR. I suppose caused by too many requests to the FLickr API. Simply restart until completion**
- New option: --add-albums-migrate is *only* available to re-run it, should it be necessary and in case the autoamted process fails.
- Handle orphanated PICs previously loaded without a Set.
- Register on badfiles also files to large reported by Flickrt on upload (feature 37).
- Display current vs total number of files processed.
- Reduce file system scannig time by not checking a file in an excluded folder (feature 36. Thanks malys).
- To confirm full resolution on: Revise try/except on upload around except error '040' (issue 28).

Questions & Answers
- Added several clarifications to Readme and Q&A section (issue 31 and 38. Thanks ze6killer).

Output Messages
- Display current vs total number of files processed.

Environment and Coding
- Python 2.7 + 3.6 compatibility.
- Python 3.7-dev: Initial tests only.
- Created function getSetNameFromFile.
- Adapted nuceprint to print function name on new otional parameter.
- Enhanced is_photo_already_uploaded function.