Wmcore

- Merge pull request 5743 from vkuznet/logdb
- Merge pull request 5760 from tsarangi/issue5672_again
- Fix 5672 . Read latest and non-empty condor log for classAd information
- Merge pull request 5759 from ericvaandering/fix_dashboard_getter_conflict
- Fix the conflicts introduced in two different pull requests
- Merge branch 'ericvaandering-multithread_taskchain'
- multi thread task chain
- Merge pull request 5758 from ericvaandering/remove_dbs2code
- Merge pull request 5752 from amaltaro/set-thresholds-ssb
- Merge pull request 5755 from ericvaandering/fix_5420
- Merge pull request 5756 from ericvaandering/report_jobtype
- Merge pull request 5753 from ericvaandering/fix_js_linefeed
- Merge pull request 5749 from hufnagel/secondary-priority
- Merge pull request 5751 from ericvaandering/dashboard_ncore_start
- Merge pull request 5708 from juztas/gfal2
- Merge pull request 5679 from tsarangi/issue5659
- Merge pull request 5699 from amaltaro/create-test-wfs
- Script to create and assign DMWM workflows
- Fix 5659 . Ignore accounting for jobs that are in X state. Fixed Exceptions Multiple typos Fixed Add job to complete list if the job status is removed Do not trust classAd and update the status to Removed if the jobStatus is New Reorder job status report. Break after jobs are pushed to completeList. Ignore getClassAd for jobs in Removed Status
- Remove DBS2 code and references
- Add CMS_JobType into the JDL. Can be for reprioritization by HTCondor or enforcing global resource control in GlideinWMS.
- Loop over tasks and find the maximum of cores to request for the job
- Re-factor ctor to use DMWM config
- Collect all user messages and only last ones for agent-X type messages
- Fix linefeeds in two javascript files
- don't change site thresholds if site not in ssb
- Report out of cores to dashboard on job start, not just job end
- Implement logic according to new set of requirements (see issue 5705)
- Implement dynamic creation of logdb_agent and upload requests view
- Move under WMCore/Services and adjusted classes to read modules from proper location
- Added production-manager and t0operator roles to global access
- Remove requests module
- Initial prototype of LogDB interface: include code base and associative couchapp
- set secondary job priority, fixes 5688
- add gfal2 support.

- Merge pull request 5666 from amaltaro/taskChain-multicore-json
- Add multicore taskchain template (request basis)
- Merge pull request 5664 from ticoann/wmstats_call_fix
- fix job info retrieval when there is no job info is available
- Merge pull request 5654 from ticoann/set_agent_number
- Merge pull request 5661 from ticoann/fix_unit_test
- fix ReportEmu_t, DashboardInterface_t
- Merge pull request 5658 from ericvaandering/clean_addfiles
- Remove addFiles function needed for forked CMSSW job report
- Merge pull request 5559 from juztas/custom_err_message
- Possibility to raise own error message
- Merge pull request 5655 from ericvaandering/remove_multicore_enabled
- Merge pull request 5652 from ericvaandering/setup_cmssw_noenabled
- Merge pull request 5650 from ericvaandering/multicore_condor_cleanup
- Merge pull request 5651 from ericvaandering/fix_mcm_service2
- Get rid of multicore enabled flag everywhere. Remove MulticoreCMSSW step type, FWJR consolidation used by old code, and various obsolete tests for the forking way of doing multicore jobs.
- Merge pull request 5649 from mmascher/master
- Merge pull request 5639 from ticoann/fix_task_chain_event_per_job
- Merge pull request 5638 from ticoann/rm_global_monitor
- set default agent number
- Remove some error trapping from McM service class, and Update to catch all exceptions McM service can throw. Do right thing when no data exists.
- Simplify setting options, remove multicore.enabled
- Change condor plugins to only key off of number of CPUs
- Add the possibility to turn off SimpleMemoryCheck in SetupCMSSWPSet
- make event per job always int for task chain
- remove global monitor code

- Merge pull request 5609 from ticoann/wmstats_cleanup2
- cleanup WMStats view and replace the all the calls
- Merge pull request 5606 from ticoann/couchdb_test
- change to warning for drain and disk space warning
- Merge pull request 5605 from tsarangi/issue4716
- Fix 5507, 5587, 4716, 4837
- Merge pull request 5604 from vkuznet/home-changes2
- Changes for home page
- Merge pull request 5594 from ticoann/fix_valid_file
- Merge pull request 5599 from vkuznet/fix-order
- Fix order behavior on web UI; move filter_sort table into separate tempalte; made date asc order as default
- handle only valid files

- Merge pull request 5525 from mmascher/master
- Add option to not clean the env in Scram.py
- Merge pull request 5472 from amaltaro/cast-runNumbers
- Merge pull request 5522 from hufnagel/remove-tier0mode
- remove tier0mode from PhEDExInjector
- Merge pull request 5491 from mmascher/master
- Merge pull request 5516 from hufnagel/phedex-deletion
- add support for phedex deletions
- Merge pull request 5505 from HassenRiahi/IncludeCAINFO
- Merge pull request 5494 from AndrewLevin/master
- Merge pull request 5485 from holzman/fnal-xrdcp-force-stageout
- Include the CAINFO param. in pycurl_manager.
- Re-implement lumi correction algorithm. Fix 5337
- changed the error code that is used when a job fails due to a jobstatuslite timeout, this will allow us to make these jobs move to jobfailed instead of jobcooloff after try
- Revert LumiCorrection algorithm
- FNAL staging: fix string concat error
- FNAL staging: use -f option for xrdcp
- temporary fix for FirstRun/LastRun wrong data type

- Merge pull request 5496 from ticoann/lumi_list_fix
- add lumilist in schema in str format
- Merge pull request 5463 from ticoann/multi_run_harvesting
- Merge pull request 5474 from ticoann/prep_id_by_task
- patch for setting prep ids per task in task chain
- Merge pull request 5495 from ticoann/move_dbs_client_import
- move the dbs import statement within the function since this package is imported in Runtime. DBS client is not in the sandbox.
- Merge pull request 5482 from amaltaro/multiRun-json
- new json template for RelVal multi-run harvesting
- Merge pull request 5484 from ericvaandering/catchup_mcm
- Also fetch McM data if total events is defined and approval time is not
- Merge pull request 5483 from ticoann/fix_priority_wmstats
- fix priority mapping
- Merge pull request 5478 from amaltaro/acdc-MCFakeFile
- fix job splitting for ACDC MCFakeFile
- Merge pull request 5466 from amaltaro/fix-inclusiveMask
- Merge pull request 5464 from ticoann/restrict_state_transition
- Merge pull request 5462 from lucacopa/tier0_status_resource_control
- Merge pull request 5461 from ticoann/fix_lexicon
- test boolean against boolean
- Cleanup status transition
- Add multi run harvesting
- Enable tier0 status for sites in SSB
- fix lexicon for dataset

- Merge pull request 5429 from ticoann/fix_when_workflow_missing_in_stat_summary
- Merge pull request 5427 from ticoann/fix_http400_error
- report 400 error
- Merge pull request 5423 from ticoann/fix_reqmgr_query
- Merge pull request 5425 from amaltaro/nEvents-noType
- Merge pull request 5422 from ticoann/ignore_failed_job_missing_record
- change to get only active request
- do not enforce data type for producer nEvents
- check task field more finely
- Merge pull request 5419 from hufnagel/multicore-optional
- make multicore in setupProcessingTask optional
- Merge pull request 5418 from dmwm/revert-5358-listFileBlockLocation_phedex_migration
- Merge pull request 5417 from dmwm/revert-5359-sitedb_pnn2psn_api
- Merge pull request 5416 from dmwm/revert-5363-remove_phedexnodetocmsname
- Merge pull request 5415 from dmwm/revert-5379-FillPNNinFWJR
- Revert "move listFileBlockLocation to using phedex node names by default"
- Revert "migrate from phEDExNodetocmsName to PNNtoPSN"
- Revert "Remove phedexnodetocmsname"
- Merge pull request 5414 from dmwm/revert-5413-db3reader-typo
- Revert "fix problems in DBS3Reader, fixed 5412"
- Revert "filling FWJR with PNN"
- Merge pull request 5413 from hufnagel/db3reader-typo
- fix problems in DBS3Reader, fixed 5412
- Merge pull request 5379 from alexanderrichards/FillPNNinFWJR
- Merge pull request 5363 from alexanderrichards/remove_phedexnodetocmsname
- Merge pull request 5359 from alexanderrichards/sitedb_pnn2psn_api
- Merge pull request 5388 from ericvaandering/mcm_datamining
- Merge pull request 5358 from alexanderrichards/listFileBlockLocation_phedex_migration
- Merge pull request 5400 from ericvaandering/fix_psetvfariable
- Merge pull request 5404 from ericvaandering/mcm_view
- Merge pull request 5392 from yuyiguo/DBFormatter
- handle different cursors for SQLAlchemy 0.5.* and 0.9.6
- Merge pull request 5407 from ticoann/add_unittest_multicore
- add unittest
- Merge pull request 5406 from amaltaro/multi-condition
- change multicore condition - take 2
- Merge pull request 5397 from amaltaro/feff-takchain
- move listFileBlockLocation to using phedex node names by default
- Merge pull request 5405 from amaltaro/fix-numberOfCores
- fix number of cores for multicore
- Add McM summary view for McM request date, of events
- Change pset to self.process
- Merge pull request 5394 from ticoann/tier0_monitor
- fix unittest for T0_Feeder
- separate tier0 request db and temporary db
- fixes filterEfficiency for TaskChain requests
- Merge pull request 5389 from ticoann/tier0_monitor
- tier0 monitor upgrade
- Add McM service calls and config to data mining
- Merge pull request 5361 from ericvaandering/mcm_service
- Merge pull request 5362 from hufnagel/merge-no-sitelists
- Merge pull request 5376 from ericvaandering/jdl_mt_settings
- Merge pull request 5375 from ericvaandering/propagate_mt_settings
- Merge pull request 5380 from amaltaro/updt-webrequest-tmpl
- Merge pull request 5381 from amaltaro/remove-dbs2-url
- Merge pull request 5385 from ticoann/fix_missing_task_in_fwjr
- Merge pull request 5384 from amaltaro/fix-jobAccou
- add function for manual intervention
- properly handle None in JobAccountant
- clean up of dbs2 urls
- Fix typos and dbs url in web request template
- filling FWJR with PNN
- Modify condor plugins for new multithreaded and move multithreaded JDL to per job customization
- Propagate multicore settings to job plugins and add strings to test code
- Add an McM service and unit test
- This is temp fix for when document is missing
- removing phedexNodetocmsName from WMCore including unittests and using PNNtoPSN instead in unittests
- don't pass sitelists to merge jobsplitter
- migrate from phEDExNodetocmsName to PNNtoPSN