A new 6.1-2 maintenance release is now available for the Qube 6.1 Core/Supervisor/Worker. This is a recommended release for all customers running Qube v6.1.
Below is a list of the fixes and enhancements.
================================================
@CHANGE: Removing Mac OS X 10.4 support.
@FIX: Handle case where database_host defined in the supervisor as 127.0.0.1
@CHANGE: add WORK_RESULTPACKAGE as an exposed mail variable
@FIX: Python API issue where null, empty or incorrect input to commands such
as qb.block() will apply the function to ALL jobs/work items
Passing a wrong parameter or a null/empty to these routines will now now
raise an exception.
BUGZID: 63565
@CHANGE: windows: pointed compiler to look for python2.7 and perl5.8 header
files, and linker to link against those library files too.
@FIX: Windows-specific bug where PreForkDaemon-based daemon's (supe , worker)
background "kin" threads were not always running their intended routines.
@TWEAK: added more useful messages to print on sending host report to supe,
and when checking job's resource requirements and reservations agains the
worker's current resources.
@NEW: add perl 5.12 support for platforms shipping with it (notably FEDORA14
at this point)
@FIX: Worker memory/swap resource tracking (Linux)
* memory/swap resource tracking was broken, as the code was adding the
reserved amount on top of the actually used values. For example, if a
subjobs has 'reservations="host.memory=1000"' and actually running and
using 900 MB, the code was incorrectly subtracting 1900 MB from the
available host.memory for the worker.
@FIX: Python API routine qb.rangechunk() crash with Bus error on certain
input.
The Python API qb.genchunk() routine was reported to crash on input that
included whitespace. It turns out that the C++ _qb_rangechunk() routine
was crashing when it had an empty input sequence.
Also fixed regex in Python API routine qb.rangechunk() to be more
permissive about whitespaces in sequence strings (i.e., " -1 - 10 x 1" is
equivalent to "-1-10x1").
BUGZID: 63559
ZD: 3401
@FIX: OSX: host swap "usage/total" collected and displayed accurately
@CHANGE: OSX: host memory usage excludes "inactive" memory
@CHANGE: OSX/Linux reverting supe to be run under the"root" account instead of
"qubesupe", to work around some file permission issues found in 6.1. This
will be changed back again in a future release (likely at 6.2).
@NEW: add RHEL 5.5 x64 and Fedora 14 x64 support.
@NEW: adding Python 2.7 support into python module Makefile, for Linux
platforms that supports it.
@FIX: fixed accuracy of the "host.memory" reports (used/total) of workers on
Linux. BUGZID: ZD: 3308
@CHANGE: removed the not-too-useful tmp_used worker host property
@FIX: fixed accuracy of tmp_used.
@FIX: changed worker code that collects the /tmp usage to use statfs(),
instead of crawling the dir (recursively), for efficiency.
BUGZID: 63475
ZD: 3175 2586
@NEW: add RHEL 5.5 x64 and Fedora 14 x64 support.
@FIX: fixed perl .xs code to accomodate interface change in perl 5.11
and above.
@FIX: disabled code (temporarily) that crawls /tmp to get its size, as
it was causing worker threads to choke on systems with large
amounts of data in /tmp.
Change with Linux code only-- other platforms (win, osx), doesn't have any
similar code that collects /tmp (or similar) size info.
BUGZID:
ZD: 3175
@FIX: fixed issue where worker_max_threads specified in qbwrk.conf
wasn't being effective.
ZD: 3175
@FIX: reduced number of retries when host is found "busy" (retry
busy), in effect reducing the blocking time of the thread down to
7 seconds max, and give up after that.
@FIX: added code to do a final check before dispatching a subjob to a
worker, to see if there's already another subjob trying to start
on it. (Check is done in the duty table for a "ghost" entry for
the host)
ZD: 3175
@FIX: attempt to discover the mysql port even if the database host is
defined
@FIX: Fixed default value of worker_max_clients to actually be the
intended value, 256
(instead of picking up the default value for worker_max_threads,
which is
.
@FIX: reverted code that attempts to automatically backoff and retry
in QbFarm::reserve(). it was causing many supe threads to stall
for a long time, eventually maxing out the max_threads and
resulting in "connection overflow.
ZD: 3164
@MINOR: added missing "@RELEASE: 6.1.2" header in RELEASE.txt
@CHANGE: optimization. add code to prevent supe from dispatching
subjobs from the same job to a worker until the worker says "no".
Works for most simple cases where "host.processors" is an integer value.
This should prevent many brief "oversubscription" of workers seen
(where the GUI would show workers running more subjobs than they
have jobslots for) when jobs are first being dispatched.
Changes made to the startJob(), startHost(), and startQualified()
routines.
Note that even with these changes, timing issues can/will still cause
dispatch-a-subjob-then-get-rejected-by-worker scenarios (which is fine).
ZD: 2646
@FIX: reverting back the supervisor python engine changes introduced
in 6.1, which was causing initilizing threads to stall/crash.
BUGZID: 63502
ZD: 2894 3047
@FIX: don't create jobstatus_sk column in job_fact; it belongs in
table version 6.
move column creation commands into upgrade_v6 script
@CHANGE: dropping python 2.2 support on Windows 32-bit.
@NEW: Add section to Installation docs detailing Win7/Vista/Server2008
considerations - re: disabling UAC and Interactive Services
Detection service
@FIX: suppressed log message that prints "IN: QbQueue::clearGhostDutys( ".
@FIX: made the qubesupe user's home to be /usr/tmp, so the "useradd"
won't fail.
@FIX: made sure that /var/log/supelog exists on startup of supe
@NEW: datawarehouse: NEW FEATURE - add 'jobstatus' column to job_fact
table to store terminal state of job in datawarehouse - Customer
request.
* also create pfx_stats.tableversion placeholder for consistency,
we already create a placeholder pfx_stats db if necessary. Set
the tableversion for the pfx_stats DB equal to 0.
@TWEAK: datawarehouse: TWEAK - allow the use of setting DATAWH_DIR
env_var to specify location of dataw/h sql scripts during
installation
@COSMETIC: datawarehouse: COSMETIC - update feedback printed during
initial job fact table creation
@FIX: updated supervisor_flags and supervisor_log_flags to show the
correct default values in the default qb.conf
@FIX: datawarehouse - fix issue observed on a couple of installs (but not
others) where the user needs explicit INSERT permissions on a TEMP table
it just created.
observed on a OSX 10.4 PPC and Ubuntu installation
@FIX: datawarehouse - missed the rename of job fact table
added ident kwords
@NEW: Makefile change to include python 2.7 support for windows
BUGZID: 63484 63483
@FIX: makefile update for the previous check-in (qubesupe privileges)
@FIX: adding code to make "qubesupe" user be a qube admin by default.
To ensure that everybody upgrading to a new release will automatically run
the code, this fix involved a creating a new table version file, version
26 (QbTableVersion26), for the supe MySQL db.
BUGZID: 63486
@FIX: Remove outdated example python scripts that are better served through
docs and in-line doc examples.
@FIX: Remove pedantic hostinfo.py example that was outdated. Use inline help
instead: help(qb.hostinfo) which provides more examples and is current.
ZD: 2745
@FIX: Added a bunch of changes into RELEASE.txt that were missed for the 6.1.0
release.
