The Complete Release notes
Table of Content
New in CFEngine Learn about the newest features in CFEngine 3.24
Supported platforms and versions These are the supported platforms for the current release.
Known issues View any issues of which we are currently aware and investigating. View possible workarounds.
New in CFEngine
See what's new in this release.
Changelog
See also: Enterprise changelog, Masterfiles changelog
3.23.0: - Added selinux policy to allow cf-hub to initiate scheduled reports (ENT-10696, ENT-9825) - Added version_compare() policy function (CFE-3991) - Bodies can now inherit attributes containing global variables (CFE-4254) - Cached policy function results now take into account number of arguments and function name (CFE-4244) - Fixed infinite loop on error bug while reading interface exception file - Fixed inventoried policy release id when masterfiles-stage.sh deploys with cfbs (ENT-10832) - Improved locale override in masterfiles stage scripts (ENT-10753) - Improved syntax description for validjson() (ENT-9759) - Made cf-support use coredumpctl for core analysis only when configured in kerenl.core_pattern (ENT-9985) - Modified classesmatching() function to search parent bundles with inherit => true (ENT-5850) - Moved expected location of ignore_interfaces.rx from $(sys.inputdir) to $(sys.workdir). If the file is found in $(sys.inputdir) but not in $(sys.workdir), we will still process it for backwards compatability, but issue a warning prompting the user to move it to the appropriate location. (ENT-9402) - Only CFEngine processes are now killed as expired lock owners (CFE-3982) - SELinux no longer blocks CFEngine deamons in reading security parameters from /proc/sys/kernel (ENT-9684) - cf-hub is now allowed to use the TLS kernel module on SELinux-enabled systems (ENT-9727) - cf_lock.lmdb is no longer restored from backup on every boot (CFE-3982) - packagesmatching() and packageupdatesmatching() now look for the software inventory databases in the state directory and use them if found. This change enables the usage of these functions in standalone policy files without the demand for specifying the default package inventory attribute in body common control. However, you still need the default package inventory attribute specified in the policy framework for the software inventory databases to exist in the first place and to be maintained. (ENT-9083) - CFEngine locks are now purged dynamically based on the local locks DB usage/size ranging from no purging (<=25% usage) (ENT-8201, CFE-2136, ENT-5898) - `cf-check repair` now rotates DB files with high usage (>95%) (CFE-3374) - Full LMDB files are now handled gracefully by moving them aside and using new empty LMDB files (ENT-8201) - `cf-check repair` now supports the `--test-write` option to check if DBs can be written to as part of identifying DBs that need repairing (CFE-3375) - `cf-check diagnose` now shows DB usage and a hint if rotation is required - /usr/bin/getent is now attempted to be used if /bin/getent doesn't exist (CFE-4256) 3.22.0: - Added --help option to cf-support and aligned output with other components (ENT-9740) - Added classes and vars to cf-support (CFE-4160) - Added condition to runalerts service to require stamp directory (ENT-9711) - Added mctp_socket class to selinux policy (ENT-10206) - Added native core dump handling in cf-support for Solaris (ENT-9786) - Added needed SELinux class lockdown for latest RHEL 9 hosts (ENT-9685) - Adjusted cf-support for exotic/legacy POSIX systems (ENT-9340) - Adjusted cf-support for hpux mktemp command (ENT-9786) - Directories are now created with correct perms (CFE-4114) - Variables & classes modules automatically tagged (ENT-7725) - Changed bootstrap policy to preserve log level for debug, verbose, and info (CFE-4121) - Created new policy function isreadable (ENT-9380) - Enabled expireafter attribute for custom promise types (CFE-4083) - Enabled install-time SELinux policy compiling (ENT-9685) - Expired agents now terminate custom promise modules (CFE-4083) - Fixed debug module expand logging for scalars (CFE-4122) - Fixed syntax description of validjson() (ENT-9759) - Prevented cf-support from searching more than 1 level for core files (ENT-9981) - Started checking status of all cf- prefixed systemd services in cf-support (ENT-9804) - validjson() no longer accepts trailing bogus data (CFE-4080) 3.21.0: - Added cf-support utility for generating support information (ENT-9037) - Adjusted cf-check and package module code for empty updates list (ENT-9050) - '$(this.promiser)' can now be used in 'files' promise attributes 'if', 'ifvarclass' and 'unless' (CFE-2262, ENT-7008) - Fixed storage promise for nfs on MacOS (CFE-4093) - Fixed definition of _low_ldt class from cf-monitord (CFE-4022) - Insertion of contents of a file with blank lines into another file with blank lines no longer results in mixed content (ENT-8788) - Added suggestion to use a negative lookahead when non-convergent edits are attempted (CFE-192) - Unresolved function calls that return scalar values are now considered OK for constraints expecting strings during syntax check (CFE-4094) - cf-monitord now honors monitorfacility in body monitor control (ENT-4492) - cf-serverd now periodically reloads its policy if it contains unresolved variables (e.g. $(sys.policy_hub) in 'allowconnect'). (ENT-8456) - cf-serverd now starts in the network-online.target on systemd-based systems (ENT-8456) - edit_line bundles can now use the new $(edit.empty_before_use) variable mirroring the value of edit_defaults=>empty_before_use of the related files promise (ENT-5866) - Package modules with unresolved variables in their names are now skipped in package queries (ENT-9377) - Removed unsupported name_connect capability for udp_socket class (ENT-8824) - 'meta' attribute can now be used in custom promises (CFE-3440) - Custom promise modules can now support the 'action_policy' feature allowing promises of their custom types to be used in dry-run and simulation modes and in combination with 'action_policy => "warn"'. (CFE-3433) - Use of custom promise modules that don't fully specify protocol now results in warning (CFE-3433) - Warnings are logged if levels of log messages from custom promise modules don't match results of their related promises (CFE-3433) - Adjusted SELinux policy for RHEL 9 (ENT-8824) - Fixed SELinux policy to allow hub to send emails (ENT-9557, ENT-9473) - SELinux no longer breaks SQL queries with large result sets on RHEL 8 hubs (ENT-9496) - Added SELinux LDAP port access for Mission Portal (ENT-9694) - Allowed ciphers are now properly split into TLS 1.3 cipher suites and ciphers used for TLS 1.2 and older (ENT-9018) - Fixed git_cfbs_deploy_refspec in masterfiles_stage leaving temp dir (ENT-9039) 3.20.0: - 'rxdirs' now defaults to "false". This means that the read permission bit no longer implies execute bit for directories, by default. Permission bits will be exactly as specified. To restore the old behavior you can still enable 'rxdirs' explicitly. (CFE-951) - 'N' or 'Ns' signal specs can now be used to sleep between signals sent by 'processes' promises (CFE-2207, ENT-5899) - Directories named .no-distrib are no longer copied from policy server (in bootstrap/failsafe) (ENT-8079) - Files promises using content attribute or template method now create files by default unless `create => "false"` is specified. (CFE-3955, CFE-3916) - template_method mustache and inline_mustache now create file in promiser, if template rendering was successfull and file does not exist. (ENT-4792) - Added support for use of custom bodies in custom promise types (CFE-3574) - Custom promise modules now never get promise data with unresolved variables (CFE-3434) - Custom promises now use standard promise locking and support ifelapsed (CFE-3434) - Enable comment-attribute for custom promise types (CFE-3432) - cf-secret encrypt now encrypts for localhost if no key or host is specified (CFE-3874) - CFEngine now builds with OpenSSL 3 (ENT-8355) - CFEngine now requires OpenSSL 1.0.0 or newer (ENT-8355) - Moved Skipping loading of duplicate policy file messages from VERBOSE to DEBUG (CFE-3934) - CFEngine processes now try to use getent if the builtin user/group info lookup fails (CFE-3937) - No longer possible to undefine reserved hard classes (ENT-7718) - Unspecified 'rxdirs' now produces a warning (CFE-951) - Fixed wrong use of log level in users promises log messages (CFE-3906) - Fixed default for ignore_missing_bundles and ignore_missing_inputs The issue here was that these attributes should default to false, but when they are assigned with an unresolved variable, they would default to true. (ENT-8430) - Added protocol 3 (cookie) to syntax description (ENT-8560) - Moved errors from data_sysctlvalues from inform to verbose (CFE-3818) - Fixed inconsistencies with methods promises and missing bundles Previously, methods promises acted differently depending on if you specify the bundle with usebundle or in the promiser string. This change removes the inconsistent checking which was only happening on promises with usebundle. It also ensures that the agent will abort if trying to use an undefined bundle, regardless of whether it was using promiser string or usebundle. This change, combined with the fix for ignore_missing_bundles and ignore_missing_inputs, allow you to use inputs and bundles conditionally (like we do for the enterprise federation policy) and still have the agent abort in the correct situations (when a bundle is actually missing and you haven't enabled ignore_missing_bundles). The downside is that there are some potential situations where undefined bundles would be detected earlier previously (both correctly and incorrectly). (ENT-8430) 3.19.0: - -N/--negate now prevents persistent classes from being defined (ENT-5886) - 'null' JSON value is now handled as empty data in augments/host-specific data (ENT-7434) - Added a new common control attribute 'system_log_level' For specifying the minimum log level required for log messages to go to the system log. (ENT-7594) - Added support for cfbs managed policy set to masterfiles staging script (ENT-7709) - Trailing commas can now be used in policy argument lists (CFE-3734) - Changed cf-key option --print-digest to take an optional argument. cf-key now defaults to the public key file in workdir, if no argument is specified or an empty string is given as the argument. (CFE-3682) - Cached functions are now always called inside promises with 'iflapsed => "0"' (CFE-3754) - Enabled 'handle' attribute for custom promise types (CFE-3439) - Enabled 'depends_on' attribute for custom promise types (CFE-3438) - Enabled 'with' attribute for custom promise types (CFE-3441) - Don't fail on new file creation when backups are enabled (CFE-3640) - Extended 'hostsseen()' policy function to return host keys (CFE-2546) - Moved httpd.pid to root of httpd workdir (ENT-7966) - Only real changes in files now produce info messages (CFE-3708) - Reports with unexpanded variable references are now attempted to be held off until the reference expands (CFE-3776) - Set apache umask to 0177 (ENT-7948) - The --skip-bootstrap-policy-run option now skips the update policy (ENT-7500, ENT-7511) - Added measurement names in cf-check dump (ENT-7452) - Value of '$(with)' is now expanded even if it contains unresolved variable references (CFE-3776) - cf-serverd now binds to both IPV6 and IPV4 if bindtointerface is unspecified (ENT-7362) - cf-serverd now reports if fails to bind to all possible addresses/interfaces (ENT-7362) - Fixed dbm_quick.c DBPrivRead() argument type (CFE-3737) - Fixed dbm_tokyocab.c DBPrivRead() argument type (CFE-3737) - Fixed crashes (Segfaults) in VariableIsSecret() (ENT-7678) - Fixed crashes (Segfaults) in VariablesMatching() (ENT-7678) 3.18.0: - "No action for file" warning is no longer triggered when only 'content => "something"' is used (CFE-3507) - "source=promise_iteration" variables are no longer created in foreign bundles (ENT-7029) - 'cf-remote install' now supports the '--trust-keys' option for pre-establishing trust before bootstrap (CFE-3485) - 'cf-remote spawn' now supports adding new VMs to an existing group (CFE-3502) - 'rename => newname()' now supports relative paths (CFE-3537) - 'variables' and 'classes' in CMDB and augments data now support 'comment' fields (CFE-3638) - Included custom promise type libraries in src tarball (CFE-3575, CFE-3576) - --ignore-preferred-augments now sets a hard class; ignore_preferred_augments This class makes it easy for cf-agent / cf-execd policy to propagate the option to other binaries (CFE-3656) - Added 'classes' body support for custom promises (CFE-3437) - Added a new --simulate=manifest-full mode New simulation mode that manifests all changed files as well as all other files evaluated by the agent run which were not skipped (by file selection rules) (CFE-3506) - Added a new runagent_socket_allow_users body executor control attribute A new attribute that tells cf-execd to grant access to the runagent.socket to the specified users (ENT-6735) - Added checks to return value from getpwuid & getgrgid (CFE-3521) - Added int() policy function (CFE-3616) - Added new command line option: --ignore-preferred-augments This option causes the agent to ignore def_preferred.json always reading def.json (old behavior) (CFE-3656) - Added policy function type() - Added policy function findfiles_up (CFE-3577) - Added policy variable sys.os_name_human (CFE-3569) - Added policy variable sys.os_version_major (CFE-3569) - Added shell library for custom promise types with cp example (CFE-3516) - Added string() policy function (CFE-3476) - Augments data now supports meta information for classes and a new 'variables' object for variables with meta information (CFE-3633) - Fixed case where malformed input could trigger buffer overflow in policy function format (CFE-3525) - Ability to report some number of lines from the END of a file by specifying number_of_lines as a negative number using printfile (CFE-3558) - CFEngine binaries now load host specific data ($(sys.workdir)/data/host_specific.json) before Augments relative to policy entry (def.json) (ENT-6789) - CFEngine processes are now properly identified in syslog on non-GNU/Linux systems (ENT-7100) - CMDB data now supports meta information for classes and a new 'variables' object for variables with meta information (CFE-3633) - Changed custom promise type interpreter attribute to be optional (CFE-3562) - Changed files promise repaired log level to verbose (CFE-3631) - Changed log message about whitespace in class expressions to be error (CFE-3560) - Changed sys var attribute names: "OS type" was changed to "Kernel", "OS kernel" was changed to "Kernel Release" (ENT-6551) - Clarified error log message about untrusted state directory not being private (CFE-3599) - Classes from augments are now defined as soft classes within the 'namespace' context instead of being hard classes. Policies using classes from augments in policy files using namespaces need to be updated to refer to the augments classes with the 'default:' prefix (CFE-3632) - Custom promise modules using JSON protocol now support data attributes (CFE-3654) - Custom promise modules using JSON protocol now support slist attributes (CFE-3444) - Custom promise types can now be declared in separate files (CFE-3510) - Custom promise types can now report back result classes (CFE-3515) - Custom promises now support the 'log_level' attribute (CFE-3436) - Each custom promise module is now only spawned once and handles all promises of its matching type(s) (CFE-3572) - Early failing custom promises now properly set result classes (CFE-3645) - Exit code from remote agent run is now sent to cf-runagent (CFE-3594) - Fixed crash when attempting to put methods promises in bundles which are not agent bundles (CFE-3672) - Fixed memory leak in package module code (ENT-5752) - Fixed memory leak in simulate mode (CFE-3498) - Fixed some more sign-compare warnings (CFE-3415) - Improved error handling / logging of data received from promise module - Improved log messages for commands promise outcomes and return codes (CFE-3604) - Made errors about failed validation of custom promises less noisy - Namespace and bundle can now be specified in augments and CMDB data (CFE-3633) - New observations of root owned SETUID programs moved from WARN to NOTICE (ENT-6519) - Policy function format() no longer truncates strings lager than 4KiB (CFE-2686) - Policy function storejson() no longer truncates strings lager than 4096 bytes (CFE-2507) - Promise type is now sent to custom promise modules (CFE-3563) - Reduced the noise caused by packages promises being skipped in evaluation passes 2 and 3 (ENT-6553) - Set Filedescriptor Limit to a more practial Size (CFE-3625) - Stopped emitting warning and recording result when observing new SETGID files (ENT-6750) - Stopped updating files promise result with WARN (notkept) when setuid files are encountered (ENT-6519) - Unspecified 'files' constraints no longer cause '_kept' classes to be defined (CFE-3578) - Updated contrib/masterfiles-stage scripts and instructions to be accurate (ENT-6165) - Fixed using a custom promise module with two different interpreters results in an error (CFE-3572) - Value of the 'files_single_copy' body control attribute is now logged in verbose logging mode (CFE-3622) - Variables and classes defined in cmdb cannot be re-defined in augments (ENT-7079) - Verbose log now contains comments associated with 'vars' and 'classes' promises (CFE-2442, CFE-2443) - cf-agent now checks that promise module logs expected errors - cf-agent now sends correct information to promise module in header - cf-execd now executes cf-agent for "localhost" requests via the runagent.socket (ENT-7090) - cf-execd now handles requests to run cf-runagent on given hosts (ENT-6182) - cf-execd now runs cf-agent from a child process instead of a thread on POSIX systems (ENT-6182) - cf-runagent now exits with a code reflecting remote agent run status(es) (CFE-3594) - cf-serverd now supports systemd-based socket activation - def_preferred.json is now used instead of def.json if it exists Old clients will ignore it, allowing you to have 2 versions of the augments file, 1 for compatibility with old clients, and 1 for utilizing the new feautres. (CFE-3656) - files_single_copy body agent control attribute can now be an empty list (CFE-3622) - files_single_copy no longer treats paths of copied files as regular expressions (CFE-3621) - log_level is properly sent to promise modules in both validate and evaluate requests (CFE-3564) - unless can now be used with custom promise types (CFE-3431) - CFEngine processes now reuse log facility from previous run for early logging before policy is loaded (ENT-6955) 3.17.0: - cf-agent can now simulate the changes done to files in a chroot, printing diff or manifest information about what it would do in a normal evaluation. Use the new command line option: `--simulate=diff` or `--simulate=manifest`. Please note that only files and packages promises are simulated currently. - Custom promise types can now be added using promise modules (CFE-3273) - cf-monitord now uses /proc/net/* files to get network information if possible (CFE-2945) - Added new policy function execresult_as_data() (CFE-3315) - Added optional argument to execresult for choosing between stdout and stderr (CFE-3108) - Outcome classes are now always defined for promiser in files promises (CFE-3369) - and(), or(), not() now return boolean and cannot be used directly in slist vars. They can now be used in other places where a boolean is expected. (Most notably and / or promise attributes). The return values can be converted to strings using concat(), if necessary (CFE-3470) - Backgrounded commands are now correctly executed in the child process (CFE-3379) - CFEngine policy bodies can now be completely empty - Directory listings in files changes monitoring are now only updated when there is a change (CFE-3382) - Promises with 'action => bg()' no longer break reporting data (ENT-6042) - Spaces inside square brackets (slist/data index) are now allowed in class expressions (CFE-3320) - Variables specifying data/list names in @() references are now expanded (CFE-2434) - Added warnings when trying to use {{.}} to expand containers in mustache templates (CFE-3457, CFE-3489) - Limited unqualified host and domain name to 511 characters (CFE-3409) - AVCs are no longer produced for CFEngine processes accessing /proc/net (CFE-3240) - Fixed how we check for `--cols` argument to `ps` (ENT-6098) - Fixed a memory leak in users promises - Fixed a small memory leak in cf-promises (CFE-3461) - Fixed expansion of variables in data/list references (CFE-3299) 3.16.0: - Added 'cf-secret' binary for host-specific encryption (CFE-2613) - 'cf-check diagnose --test-write' can now be used to test writing into LMDB files (ENT-4484) - 'if' constraint now works in combination with class contexts (CFE-2615) - Added $(sys.cf_version_release) variable (ENT-5348) - Added new macros to parser: else, maximum_version, between_versions, before_version, at_version and after_version. Version macros now accept single digits (CFE-3198) - Added cf-postgres requirement to cf-apache and cf-hub systemd units (ENT-5125) - Added files promise content attribute (CFE-3276) - Added string_trim() policy function (CFE-3074) - Added warning if CSV parser parses nothing from non-empty file (CFE-3256) - All changes made by 'files' promises are now reported. Also, directory and file creations are now properly reported as 'info' messages. And failures in edit_xml result in promises marked as failed not interrupted. Purged dirs and files are reported as repaired (ENT-5291, CFE-3260) - Bootstrap to loopback interface is now allowed, with a warning (CFE-3304) - Client initiated reporting was fixed on RHEL 8.1 (ENT-5415) - Fixed rare crashing bug when parsing zombie entries in ps output. The problem was only ever observed on AIX, but could theoretically happen on any platform depending on exact libc behavior. (ENT-5329) - Fixed an issue causing duplicate entries in sys.interfaces, and sys.hardware. (CFE-3046) - Fixed ifelse() to return fallback in case of unresolved variables (ENT-4653) - Fixed locking of promises using log_repaired / log_string with timestamps (CFE-3376) - Fixed memory leak in handling of inline JSON in policy evaluation - Fixed memory leak in readlist functions (CFE-3263) - Fixed race condition when multiple agents are acquiring critical section locks simultaneously (CFE-3361) - Fixed selection of standard_services when used from non-default namespace (ENT-5406) - Fixed service status cfengine3 on systemd managed hosts (ENT-5528) - Fixed some memory leaks and crashes in policy evaluation (CFE-3263) - Improved error message for invalid body attribute names (CFE-3273) - Improved management of secondary groups to avoid intermediary state failures (ENT-3710) - LMDB files are now created with correct permissions (ENT-5986) - Log messages about broken Mustache templates are now errors (CFE-3263) - Made classfiltercsv() fail properly on invalid class expression index - Measurements promises with no match no longer produce errors (ENT-5171) - Moved error reading file in countlinesmatching() from verbose to error (CFE-3234) - Added new data validation policy functions validdata() and validjson() (CFE-2898) - New version checking convenience policy functions (CFE-3197) Added the following policy functions to check against local CFEngine version: - cf_version_maximum() - cf_version_minimum() - cf_version_after() - cf_version_before() - cf_version_at() - cf_version_between() - Removed (USE AT YOUR OWN RISK) from cf-key help menu for -x (ENT-5090) - Rewrote helloworld.cf to use files promises content attribute (CFE-3276) - The outcome classes are now defined for the top-level directory when 'include_basedir' is 'false' (ENT-5291) - Variable references with nested parentheses no longer cause errors (CFE-3242) - cf-check: Added a more user friendly message when trying to print unknown binary data (ENT-5234) - cf-check: Added data validation for cf_lastseen.lmdb (CFE-2988) - cf-check: Added nice printing for nova_agent_executions.lmdb (ENT-5234) - cf-check: Added validation for timestamps in cf_lock.lmdb (CFE-2988) - cf-check: Added validation for timestamps in lastseen.lmdb (CFE-2988) - cf-check: Fixed issue causing repair to target the wrong database file (ENT-5309) - cf-check: Symlinked LMDB databases are now preserved in repair Performs diagnosis and repair on symlink target instead of symlink. Repaired files / copies are placed alongside symlink target. In some cases, the symlink target is deleted to repair a corrupt database, and the symlink is left as a broken symlink. This is handled gracefully by the agent, it will be recreated. Broken symlinks are now detected as an acceptable condition in diagnose, it won't try to repair them or delete them. (ENT-5162) - storage promises managing nfs mounts should now correctly mount after editing fstab entries 3.15.0: - New policy function basename() added (CFE-3196) - Added read_module_protocol() policy function This function reads module protocol from a file, and can be used for caching the results of commands modules. (CFE-2973) - The @ character is now allowed in the key of classic arrays defined by the module protocol (CFE-3099) - nth() policy function now supports negative indices (CFE-3194) - Fixed .xy floating point numbers parsing in eval() (CFE-2762) - Added inform constraint to commands promises, to allow suppression of INFO log messages (CFE-2973) - Changed unless constraint to be more consistent with if For any situation where if would NOT skip a promise, unless will cause the promise to be skipped. When there are unresolved variables / function calls, if will skip, unless will NOT skip. (CFE-3160) - Default minimum allowed TLS version is now 1.1 (ENT-4616) - Network protocol version 2 is now called "tls" "tls" or "2" can be used in places where you specify network protocol. Log messages were altered, to show "tls" instead of "latest". (ENT-4406) - Introduced protocol version 3 - "cookie" This protocol is identical to version 2 ("tls"), except it allows the enterprise reporting hub to send the COOKIE command to enterprise hosts. This command is used for detecting hosts using duplicate identities. Protocol version "latest" now points to version 3. For community installations, it should not make a difference, policy servers will not send this command. The only visible difference is the new version number (in logs and policy). (ENT-4406) - Package modules now hit network when package cache is first initialized (CFE-3094) - Fixed promise skipping bug in unless (CFE-2689) - Fixed error message for unexpanded variables in function calls in unless (CFE-2689) - Prevented buffer overflow when policy variable names are longer than 1024 bytes - Zero bytes in class guards no longer cause crashes (CFE-3028) - Fixed bug in ps parsing on OpenBSD / NetBSD causing bootstrap to fail - Fixed crash in policy/JSON parsing of numbers with too many decimal points (CFE-3138) - copy_from without preserve now respects destination mode (ENT-4016) - Removed stime_range and ttime_range constraints from promise hash (ENT-4921) - Fixed promise result when using process_stop in processes type promises (ENT-4988) - cf-execd now sends SIGKILL to the agent process in case of agent_expireafter, after attempting SIGINT and SIGTERM (CFE-2664) - cf-serverd now tries to accept connection multiple times (CFE-3066) - Fixed multiple measurements tracking growth of same file (ENT-4814) - Set create permissions of monitord files in state directory to 0600 0600 matches the permissions enforced by policy. Affected files: * state/cf_incoming.* * state/cf_outgoing.* * state/cf_users * state/env_data (ENT-4863) - Clarified descriptions of io_writtendata and io_readdata (ENT-5127) - Clarified log message about process_count and restart_class being used concurrently (CFE-208) - Agent runs that hit abortclasses now record results (ENT-2471) - An ID of rhel in os-release file will now define both rhel and redhat classes (CFE-3140) - Version specific distro classes are now collected by default in Enterprise (ENT-4752) - redhat_8 and redhat_8_0 are now defined on RHEL 8 (CFE-3140) - Added derived-from-file tag to hard classes based on /etc/redhat-release (CFE-3140) - Added sys.bootstrap_id policy variable containing the ID from /var/cfengine/bootstrap_id.dat, if present (CFE-2977) - sys.interfaces now contains interfaces even when they only have IPv6 addresses (ENT-4858) - IPv6-only interfaces added to sys.hardware_(addresses,mac) (CFE-3164) - IPv6 addresses are now added to policy variable sys.ip_addresses (CFE-682) - IPv6 addresses now respect ignored_interfaces.rx (CFE-3156) - Hostname now allowed in bindtoaddress (CFE-3190) - Fixed issue when removing comments from files in various policy functions This also fixes many erroneous occurences of the error message mentioning: [...] because it legally matches nothing (A warning can still appear if a comment regex actually matches nothing). Also made this comment removing logic faster. Affected functions include: * readstringlist() * readintlist() * readreallist() * peers() * peerleader() * peerleaders() * data_readstringarray() * data_readstringarrayidx() * data_expand() * readstringarray() * readstringarrayidx() * readintarray() * readrealarray() * parsestringarray() * parsestringarrayidx() * parseintarray() * parserealarray() (CFE-3188, ENT-5019) - Fixed memory leak in JSON / env file parsing (CFE-3210) - Fixed memory leak in handling of nfs / fstab (CFE-3210) - Fixed memory leak in string_replace() and regex_replace() (CFE-3210) - Fixed memory leak when using with constraint (CFE-3210) - Fixed minor memory leak in policy evaluation (CFE-3210) - Fixed small memory leak in SQL database promises (CFE-3210) - Received SIGBUS now triggers a repair of local DBs (CFE-3127) - Corrupted LMDB files are now automatically repaired (CFE-3127) - Keys in the lock database, cf_lock.lmdb, are now human-readable (CFE-2596) - Local databases now use synchronous access on AIX and Solaris (ENT-4002) - Report corrupted local database with a critical log message (CFE-2469) - Local DB errors are now logged with the particular DB file path (CFE-2469) - cf-check: repair now preserves readable data in corrupted LMDB files (CFE-3127) - cf-check: --dump option was added to the backup command - cf-check: Added --no-fork to diagnose command (CFE-3145) - cf-check: Added -M manpage option and other common options (CFE-3082) - cf-check: No DB files in state dir now causes errors - cf-check: dump command now dumps DB contents to JSON5 (CFE-3126) - cf-check: help command can now take a topic as argument 3.14.0: - A bootstrap_id.dat file is now generated on every bootstrap (CFE-2977) - Added options to cf-net to set minimum TLS version and ciphers (ENT-4617) - Added --no-truncate option to cf-key This option, when used with --show-hosts changes the formatting of the output. Instead of padding and truncating each of the fields, they are printed, in full, with no padding, and separated by a single tab character. The output is not as pretty, but should be more useful for parsing by other scripts / tooling. (CFE-3036) - Added a new option --skip-db-check to agent and execd This option allows you to enable/disable database (LMDB) consistency checks. Initially it is disabled by default, but this will likely change. (CFE-2893) - Added a new utility to contrib: cf-remote cf-remote is a python + fabric tool to log in to remote hosts you have ssh access to. It can be used to download, transfer, and install CFEngine packages as well as bootstrapping etc. At this point, cf-remote is not packaged with CFEngine, but can be installed separately from: https://github.com/cfengine/cf-remote (CFE-2889) - Added derived-from-file tags to hard classes based on /etc/debian_version and /etc/issue - Added a function to filter CSV-files by classes (CFE-2768) - Forward slash is now an allowed character in module protocol commands (CFE-2478) - Augments files can now handle class expressions by appending '::' A condition in an augments file is treated as a class expression if it ends in ::. Otherwise it is treated as a regular expression. (CFE-2954) - Internal ps command can now handle longer usernames (CFE-2951) - Made copylink_pattern honor '/../' in copy source (CFE-2960) - CSV parser now supports CRLF inside double quotes (ENT-4504) - Added an error when a function defining a variables still fails at pass 3 (CFE-2983) - Documented cf-execd and cf-serverd response to SIGHUP in manpage (CFE-2853) - Stopped trimming leading zeroes in ubuntu minor version class The old version detection logic (using /etc/debian_version) was converting the minor version part to an integer, defining ubuntu_18_4 instead of ubuntu_18_04. The new platform detection (based on /etc/os-release) defines ubuntu_18_04. Since both old and new methods are running to maximize compatibility, both ubuntu_18_04 and ubuntu_18_4 were defined. This commit ensures that the old detection logic treats the minor version (the 04 part) as a string, not an integer. The change is specific to Ubuntu, and should affect Ubuntu 18.04, 16.04, 14.04, etc. (CFE-2882) - SUID log permissions are now properly enforced (CFE-2919) - Agent log file names are now always lowercase - Extended module with file protocol for data (CFE-3050) - Fixed a segfault in 'cf-promises -p json-full' (CFE-3019) - Added cf-key help output to indicate ability to delete by key digest (CFE-2997) - Fixed disabling TLS 1.0 (CFE-3068) - Fixed growing memory footprint of daemons (CFE-3032) - Fixed the log message about setting collect_window (ENT-4238) - Fixed the log message when parsing TIME in 'ps' output fails - Fixed parsing of YAML values starting with numbers (CFE-2033) - Fixed sys.flavor on AIX (ENT-3970) - Fixed 6 cases where promises could get the wrong outcome All cases were related to error handling and detected using static code analysis (LGTM). They were limited to cf-monitord and cf-agent (guest_environments and files promise types). Due to a programming mistake, promise results would sometimes be overwritten with 'skipped' outcome. Keeping the previous value or making the promises 'not kept' is expected behavior. Added a query to our CI (LGTM) to make sure we catch this error on new contributions. - Fixed an issue while parsing ps output on AIX (ENT-4295) - Fixed a memory leak in filesexist function (ENT-4313) - Fixed a memory leak in mustache rendering (ENT-4313) - Fixed a memory leak in: differences(), intersection(), unique() (ENT-4586) - Fixed a segfault in policy parser (ENT-4022) - Connection cache is now global (CFE-2678) - Increased verbosity of AcquireLock permission error (ENT-4395) - Message about invalid class characters from module protocol moved to VERBOSE (CFE-2887, CFE-3008) - Prevented buffer overflows in cf-monitord data parsing - Private keys generated by cf-key are no longer encrypted Private key files encrypted with a broken cipher and default hard coded passphrase provide no real security, and is only an inconvenience. Maybe it was intended to add a password prompt later, but it's been 10 years now, and the cipher and passphrase remain untouched. The function which reads keys still supports both encrypted and unencrypted keys, it will decrypt if necessary. - Reduce SSL/TLS shutdowns on bad networks (CFE-3023) - Removed programming error in handling of process_count body Previously, having a failing function call inside in_range_define or out_of_range_define would cause a programming error when trying to define that as a class. Fixed it by detecting the case, printing a normal error, and skipping defining the class. (CFE-2067) - Set policy->release_id to "failsafe"/"bootstrap" when running failsafe.cf (CFE-3031) - Switched permissions of various temporary files in state to 0600 These files were created with 0644 permissions, and then repaired in policy. However, since they are deleted / recreated periodically, it causes INFO noise. Safer and better user experience to create them with restricted permissions to begin with. Affected files: * $(sys.statedir)/cf_procs * $(sys.statedir)/cf_rootprocs * $(sys.statedir)/cf_otherprocs (ENT-4601) - string_split segments are now truncated to 1024 bytes instead of crashing (CFE-3047) - Unresolved function calls in process_select body are now skipped Function calls which always fail, like getuid("nosuchuser"), are never resolved. Previously this would cause a programming error, since the body is expected to have a list of strings, not unresolved function calls. The function calls are silently skipped (with a verbose message) as this matches the behavior of calling the functions in a vars promise, and using that as a body parameter. (CFE-1968) - cf-check directories can now be controlled from ENV vars (CFE-2994) - cf-check: Added backup command This command copies lmdb files to a timestamped backup directory. (ENT-4064) - cf-check: diagnose and backup now use state directory by default (ENT-4064) 3.13.0: - Add support for TLS 1.3 and its ciphersuites - Add 'feature' hard classes for supported TLS versions Different versions of TLS are supported depending on what version of OpenSSL CFEngine was compiled and linked with. Newly added feature hard classes bring that information to the policy. Classes like these are now defined (for supported versions of TLS): feature_tls source=agent,hardclass feature_tls_1 source=agent,hardclass feature_tls_1_0 source=agent,hardclass feature_tls_1_1 source=agent,hardclass feature_tls_1_2 source=agent,hardclass feature_tls_1_3 source=agent,hardclass - Add a new variable $(sys.default_policy_path) A new sys variable that provides the path of the default policy file evaluated when no file is specified with the '-f' option. - Add an option to skip the initial policy run on bootstrap In some cases it may not be desired to run the policy as the last step of the bootstrap. This can be done with the new '--skip-bootstrap-policy-run' option for cf-agent. (CFE-2826) - Trigger promises.cf as the last step of bootstrap (CFE-2826) - Add support for overriding the package module's path (CFE-2103) - Add support for setting package module interpreter (CFE-2880) - Added --log-level option to all components This allows you to specify any log level (info, verbose, debug etc.). It is also less strict, allowing different spelling. As an example, --log-level i, --log-level INFO, --log-level inform are all the same. - Added a new binary: cf-check Corrupt local databases (LMDB) continues to be a problem. cf-check will be used to diagnose and remediate problems with corrupt databases. It is a standalone binary, which doesn't evaluate policy or use the local databases, thus it can be used in situations where the other binaries like cf-agent would hang. cf-check replaces our lmdb database dumper, lmdump. cf-check lmdump or symlinking / renaming it to lmdump will make cf-check have the exact same behavior as lmdump. cf-check will include much more functionality in the future and some of the code will be added to other binaries, for example to do health checks of databases on startup. Ticket: (ENT-4064) - Added function string_replace. (CFE-2850) - Allow dots in variable identifiers with no such bundle As described and discussed in CFE-1915, defining remote variables (injecting variables into remote bundles) is dangerous and must be blocked. However, using a dot-separated common prefix for variables raises no security concerns and can be considered valid. (CFE-1915) - Allow requiring TLS 1.3 as the minimum version - Apply augments after vars, classes and inputs in def.json (CFE-2741, CFE-2844) - Bundle name is now part of the log message when aborting a bundle (CFE-2793) - Class names set by module protocol are automatically canonified (CFE-2877, CFE-2887) - Classes failsafe_fallback and bootstrap_mode are now reported by default - Correct log level for data_readstringarray* (CFE-2922) - Do not iterate over JSON objects' properties in mustache (CFE-2125) - Do not render templates when passed invalid data (CFE-2194) - Eliminated error messages caused by attempting to kill expired processes (CFE-2824) - Fix cf-runalerts systemd unit conditions so the service will run (ENT-3929) - Fix the off-by-one error in cf-runagent background process spawning (CFE-2873) - Fixed OOB read / heap buffer overflow in evaluator (ENT-4136) - Fixed a memory leak which occured when reloading RSA keys from disk (CFE-2857) - Fixed a memory leak which occured while loading augments files (CFE-2913) - Fixed an issue with splay time in cf-execd (CFE-2931) - Fixed error handling and memory leak in cf-key (CFE-2918) - Fixed memory leak in JSON to policy conversion (ENT-4136) - Fixed memory leak in lmdb cleanup (CFE-2918) - Fixed memory leaks in cf-agent during bootstrap (CFE-2918) - Fixed memory leaks in variablesmatching() and findfiles() (CFE-2918) - Fixed missing class with mustache templates in warn_only mode (CFE-2600) - Fixed small memory leak in cf-serverd (CFE-2918) - Fixed small memory leak in cf-upgrade (ENT-4136) - Fixed small memory leaks of environment variable strings (CFE-2918) - LMDB database dumper, lmdump, no longer creates empty databases (ENT-4064) - Made variablesmatching functions treat args regexes more correctly variablesmatching() and variablesmatching_as_data() no longer use string comparison to find matches. The documentation is clear; arguments should be regexes (so you have to escape special characters). bundle agent main { vars: "myvar" string => "example", meta => {"os[linux]"}; "matches" slist => variablesmatching(".*", "os\[linux\]"); reports: "Match: $(matches)"; } The above example is correct. If you don't escape the brackets like above, it will no longer work. (You probably shouldn't use brackets in tags anyway). - Prevent the init script from managing processes inside containers (ENT-3800) - Read mustache-rendered files in text mode when comparing digest (ENT-2526) - Reload persistent classes on config reload in cf-execd and cf-serverd (CFE-2857) - Fixed issue with @if macro failing when it is on the first line. (CFE-2817) - Fixed issue with cf-agent intermittently hanging on windows sometimes (ENT-3756) - Change GIT_BRANCH to GIT_REFSPEC and remove Design Center vars (ENT-4023) - os-release file is now used for hard classes and sys.flavor on all linuxes This will improve platform detection on newer operating systems where /etc/os-release (or /usr/lib/os-release) is present. A hard class will be set for the value of the ID key (canonified with underscores), if it exists. If both ID and VERSION_ID exist, multiple hard classes will be set for all parts of the version number. The special variable sys.flavor will also be set by determining major version from VERSION_ID. Example os-release file: ID=coreos VERSION_ID=1185.3.0 For the example above, sys.flavor will be coreos_1185 and 4 hard classes will be set; coreos_1185_3_0, coreos_1185_3, coreos_1185, and coreos. For backwards compatibility, older distribution specific logic is still executed and may overwrite sys.flavor and define hard classes as before. - Refactor use of atexit to use custom cleanup function instead. On Windows atexit() unloads DLLs before and/or during atexit functions being called which causes bad behavior. (ENT-3756) 3.12.0b1: New Features: - Add a --key-type option to specify RSA key size to cf-key - New hash_to_int policy function (CFE-2733) - Issue a warning on ignored locking attributes (CFE-2748) - Add IPv6 hard classes with the "ipv6_" prefix (CFE-2310) - Introduce "missing_ok" attribute in body copy_from This allows to ignore missing sources in file copy operations (CFE-2365) - Enable Xen hypervisor detection on all x86 platforms (CFE-2203) - Add sys.policy_entry variables (CFE-2572) - Added inline_mustache template method (CFE-1846) - New component cf-net (cf-net is a CLI for the CFEngine network protocol, useful for debugging, testing etc) and accompanying policy variable sys.cf_net containing path to cf-net binary Changes: - Load augments at the end of context discovery This means that classes defined as part of the context discovery (e.g. 'am_policy_hub' and 'policy_server') can be used in the augments (CFE-2482) - Open measurements promise type from enterprise cf-monitord - Transform filesexist() into a collecting function (CFE-2744) - Load process table when actually needed for a processes promise (ENT-2536) - Ignore commented out entries in fstab when edit_fstab is true (CFE-2198) - Do not move obstructions in warn policy mode (CFE-2740) - Made the max bytes parameter to file reading functions optional (CFE-2656) - Do not tag large volatile variables for inventory sys.interfaces_data, sys.inet and sys.inet6 are commonly larger than the maximum data size allowed to be collected by cf-hub. Data larger than 1k is truncated. Instead of reporting truncated data this change stops tagging the variable so that it will not be collected to the Enterprise hub and will not be available in Mission Portal. (ENT-3483) - cf-execd now re-parses augments on policy reload (CFE-2406) - Improve misleading verbose message For constraints if/ifvarclass/unless, we now print the whole rval of the constraint. Previously the message was just "skipping variable because ifvarclass is not defined" while the variable itself was defined. Old message example: verbose: Skipping promise 'mailto' because 'if'/'ifvarclass' is not defined Changed to: verbose: Skipping promise 'mailto' because 'ifvarclass => not(isvariable("mailto"))' is not defined (CFE-2697) - Promise comments for file changes moved to verbose (ENT-3414) - Suppress output from systemctl based restart of services in bootstrap/failsafe (CFE-1459) - Parser can now handle larger inbut buffers (CFE-1886) - Improve logging of ACL errors (ENT-3455) - cf-execd systemd service now only kills cf-execd itself (ENT-3395) - Load multiple augments from "augments" string array in def.json (CFE-2084) - Improve support for Alpine Linux - Set the exit value when running cf-key When running cf-key to generate new keys, set the exit value of the program to be 0 on success and 1 on failure. This makes it easier to catch errors during setup of a new machine. Change the default behavior of the program to not write anything to stdout, opting to use the Log() function which can write to stdout and will also allow output to be sent to syslog. Add a --inform option to set the global log level to LOG_LEVEL_INFO. Change the permissions of the randseed file to 600 and catch the exception if the chmod call fails. - Properly reverse-resolve DNS names longer than 63 chars (ENT-3379) - Properly redirect init script to systemd on debian systems (ENT-3326) Bug fixes: - Disallow modifications of variables from a remote bundle (CFE-1915) - Speedup evalution by not copying variables table when expanding a promise (CFE-2524) - Resolve subkey conflicts when converting to JSON Whenever there is a conflict of array variable definitions prefer the container subkeys over simple values when converting to JSON (CFE-2536) - Do not ignore meta promises in server bundles (CFE-2066) - Add a debug log for computed class in splayclass - Don't error when calling isexecutable on broken link (CFE-741) - Fix segfault when no show-evaluated-vars/classes is specified - Fix memory leak in cf-execd, triggered when sending email failed (CFE-2712) - Fix IPv6 parsing to be un-reversed (CFE-2580) - Fix bug preventing permission changes on Unix sockets (CFE-1782) - Fix storage mount promise when existing mountpoint has a similar path (CFE-1960) - Fix segfault when cf-promises -p is called against a file with syntax errors (CFE-2696) - Fix rare cf-execd hang (CFE-2719) - Fix mergedata segfault when called on a non-container (CFE-2704) - Do not segfault if policy_server.dat only contains whitespaces and/or line breaks - Fix segfault on JSON policy files with no bundles and bodies (CFE-2754) 3.11.0: New Features: - Allow function calls in promiser using universal "with" attribute (CFE-1092) - Add example of with attribute (CFE-1092) - Detect Amazon Linux and set "AmazonLinux" hard class and sys.flavour variable - New sysctlvalue() and data_sysctlvalues() functions from /proc/sys (CFE-2513) - readdata() also auto-detects .yml files as YAML - Added support for ENV and CSV file parsing (CFE-1881) - Added vars and classes for CoreOS (ENT-3043) - cf-agent: implement --show-evaluated-vars and --show-evaluated-classes - Support for custom ports and host names as policy hub (CFE-953) - cf-promises: allows --show-vars and --show-classes to take an optional filter - Added a new tool: cf-net. cf-net is a CLI for the CFEngine network protocol, useful for debugging, testing etc (CFE-2493) - New policy variable: sys.cf_net contains path to cf-net binary - Read /etc/os-release into sys.os_release (CFE-1881) Changes: - readintlist() now prints an error if the file contains real numbers, not integers, and aborts; previously it was printing an info-level error message, was half-reading an integer out of the real, and was continuing successfully. - "make tar-package" should create a tarball with the contents of "make install" (ENT-3041) - Allow opening symlinks owned by root or by the current user (CFE-2516) - Change warning message about depth_search on a non directory to DEBUG level - Ensure synchronous start and stop with systmectl (ENT-2841) - Put logs in /var/log and PID files in /var/run when using FHS layout (CFE-2449) - readstringlist(), readintlist(), readreallist(): Print verbose instead of error message if file can not be read - cf-serverd: Do not close connection when file does not exist (CFE-2532) - policy_server.dat now appends a newline and supports host & port - Allow string_head and string_tail to take negative arguments - getvalues(inexistent_var) returns an empty list. Restores 3.7.x and earlier behaviour. (CFE-2479) - Partially restore old getvalues(array) behaviour Bugfix: getvalues() now behaves correctly for old CFEngine arrays of depth 1 Behaviour change: it always returns a list now. Even when v is a simple string (i.e. not an iterable) it will return an slist with one element: the value of the string variable. Known issues: getvalues() still misbehaves with double-indexed arrays (see CFE-2504, CFE-2536) - The source version of CFEngine now installs binaries into bin folder instead of sbin folder (CFE-2448) - Don't error during dry run for proposed execution (CFE-2561) - Print verbose instead of error message when readfile() fails (CFE-2512) - cf-serverd: Auto configure max open files ulimit according to maxconnections (CFE-2575) - Made the max bytes parameter to file reading functions optional. Affects readfile(), readenvfile(), readcsv() Bug fixes: - Fix insert_lines related memory corruption (CFE-2520) - Prevent LMDB assertion on AIX by ensuring nested DB calls are not occuring during signal handler cleanup (CFE-1996) - Fix a bug which could cause cf-execd to believe there was an error when sending the email report, when there really wasn't - zendesk#3204: Fix "lastseenexpireafter" 32-bit signed int overflow - Fix cf-execd not exiting immediately with SIGTERM on AIX (ENT-3147) - Fix automatic service stops based on runlevel (redhat/centos) (CFE-2611) - Fix cf-serverd crash when reporting corrupted data (ENT-3023) - Fix rare output truncation on Solaris 10/11 (CFE-2527) - Fix crash on Solaris when ps ucb variant is not available (CFE-2506) - Fix logic to detect when running under a Xen Hypervisor (CFE-1563) - Fix "lastseenexpireafter" 32-bit signed int overflow (zendesk#3204) - Fix IPv6 parsing to be un-reversed (CFE-2580) 3.10.0: New features/additions: - All new features/additions for 3.8 and 3.9 are also included in 3.10. - Add: Classes body tailored for use with diff - New feature: Classes promise: allow classes without an expression to default to defined. - Support for custom ports and host names as policy hub (CFE-953) - Add: Definition of from_cfexecd for cf-execd initiated runs (CFE-2386) - Add < <= > >= operators to eval(). - Add testing jUnit and TAP bundles and include them in stdlib.cf - New function isipinsubnet() (ENT-7949) - LogDebug(): implement module-based debug logging. Now most DEBUG messages are *not* printed even when "-d" is in use, but the specific debug module has to be enabled on the command line. For example to enable all log modules, run: cf-agent -d --log-modules=all - Add: edit_line contains_literal_string to stdlib - Add variablesmatching_as_data() function paralleling variablesmatching() (Redmine #7885) - Allow specifying agent maxconnections via def.json (CFE-2461) - Add getuserinfo() function - Add body agent control select_end_match_eof option. (CFE-2390) - Add class to enable post transfer verification during policy updates - Add ability to append to bundlesequnece with def.json (CFE-2460) - policy_server.dat now appends a newline and supports host & port Changes: - Rewrite iteration engine to avoid combinatorial explosion with nested variable expansions. This speeds up enormously the execution of policies that included long slists or JSON containers, that in the past didn't even terminate. Change: "cf_null" string literal was changed to not be something special, and it's now a string that can be used anywhere, like in slists or part of bundlesequence etc. NOTE: Old policy should be grep'ed for "cf_null" and in case such occurences were handled specially, they should be reworked. Change: "--empty-list--" is now never printed by format(), an empty list is now printed as "{ }". Change: Order of pre-evaluation was slightly changed, A new "vars" pass at the beginning of pre-evaluation was added. It used to be classes-vars, but it was changed to vars-classes-vars. As a result some classes or variables might be evaluated at a different time than before. As always try to write policy code that works no matter what the order of execution is. One way is to always *guard* the execution of functions to avoid bogus function results. For example the following will avoid running execresult() bevore the file has been created: execresult("cmd /path/to/filename") if => fileexists("/path/to/filename"); C internals: NULL Rlist is now perfectly valid, in fact it is the only way to denote an empty Rlist. C internals: Since a slist variable can be NULL, API of EvalContextVariableGet() changed: The way to detect if a variable is found, is not to check return value for NULL, but to check returned *type* for CF_DATA_TYPE_NONE. Fixed what I could find as wrong API uses. (CFE-2162) - Allow arbitrary service policies (CFE-2402) - Behaviour change: cf-execd: Do not append -Dfrom_cfexecd to exec_command . (CFE-2386) - Failsafe/Bootstrap no longer copy files starting with .git (like .gitignore) or .mailmap (CFE-2439) - Change: Enable strict transport security - Change: Disable http TRACE method - Change: Verify transfered files during policy update - Allow getvariablemetatags() and getclassmetatags() to get a specific tag key - Change: Use more restrictive unix socket perms (ENT-2705) - Add sys.user_data container for user starting agent. - Pass package promise options to underlying apt-get call (#802) (CFE-2468) - Change: Enable agent component management policy on systemd hosts (CFE-2429) - Change: Switch processes restart_class logging to verbose - Change: Log level for keeping verbatim JSON to DEBUG (CFE-2141) - Change: Require network before CFEngine services (CFE-2435) - Behaviour change: getvalues(inexistent_var) returns an empty list. Restores 3.7.x and earlier behaviour. (CFE-2479) - Behaviour change: when used with CFEngine 3.10.0 or greater, bundles set_config_values() and set_line_based() are appending a trailing space when inserting a configuration option with empty value. (CFE-2466) - Behaviour change: getvalues() always returns a list now. Even when v is a simple string (i.e. not an iterable) it will return an slist with one element: the value of the string variable. - Behaviour change: readintlist() now prints an error if the file contains real numbers, not integers, and aborts; previously it was printing an info-level error message, was half-reading an integer out of the real, and was continuing successfully. - Ensure synchronous start and stop with systemctl (ENT-2841) - Change select_region INI_section to match end of section or end of file (CFE-2519) Bug fixes: - Fix files promise not setting ACL properly on directories. (CFE-616) - Upgrade CFEngine dependencies to the following versions: - lixml2 2.9.4 - OpenSSL 1.0.2j - LibYAML 0.1.7 - Curl 7.50.3 - Fix cumulative() to accept up to 1000 years, like it's documented. - Fixed parsing of host name/IP and port number in cf-runagent (CFE-546) - Fix intermittent error message of type: "error: Process table lacks space for last columns:" (CFE-2371) - storage: Properly initialize the list of current mounts (CFE-1803) - Fix 'contain' attribute 'no_output' having no effect when the 'commands' promise is using 'module => "true"'. (CFE-2412) - Fix bug which caused empty emails to be sent from cf-execd if there was no previous output log and the new log was fully filtered by email filters. (ENT-2739) - Allow ifelse(FALSE, $(x), "something else") to work. (CFE-2260) - Fix connection cache, reuse connections when possible. (CFE-2447) - Fix rare bug that would sometimes prevent redis-server from launching. - Fix bug in files promise when multiple owners are promised but first one doesn't exist, and improve logging . (CFE-2432) - Define kept outcome with action warn if edit_line is as expected (CFE-2424) - Example using getvariablemetatags() and getclassmetatags() to get a specific tag key - Remove 2k limit on strings length when writing JSON policies (CFE-2383) - Fix ttime_range constraint to go higher than 2G as number of seconds. - Change: cronjob bundle tolerates different spacing - Allow editing fields in lines longer than 4k (CFE-2438) - Don't send empty emails for logs where everything is filtered. (ENT-2739) - Allow maplist(), maparray(), and mapdata() to evaluate function calls during iteration (ARCHIVE-1619) - insert_lines is no longer implicitly matching EOF as end of the region if 'select_end' pattern is not matched . (CFE-2263) - Change: Remove executable bit from systemd units (CFE-2436) - cf-serverd should reload def.json when reloading policy (CFE-2406) - Fix cf-monitord detection of usernames of the process table on AIX. - Speed up local and remote file copying and fix spurious errors. (ENT-2769) - Fix occasional segfault when running getindices() on a variable that has indices of multiple depths (e.g. both "a[x]" and "a[x][y]"). (CFE-2397) - When no file is provided when calling cf-promises with cf or json output, use promises.cf by default. This restores the previous behavior. (CFE-2375) - Fix: Services starting or stopping unnecessarily (CFE-2421) - Change: Split systemd units (CFE-2278) - EOF is matched as an end of the region in edit_line promises only if 'select_end_match_eof' parameter is true. (CFE-2263) - Fix double logging of output_prefix, and log process name for cf-agent syslog messages. (CFE-2225) - Be less verbose if a network interface doesn't have a MAC address. (CFE-1995) - Fix: CFEngine choking on standard services (CFE-2806) - Fix insert_lines related memory corruption (CFE-2520) - Fix cf-serverd crash when reporting corrupted data. (ENT-3023) - Fix ability to manage INI sections with metachars for manage_variable_values_ini and set_variable_values_ini (CFE-2519) - Fix apt_get package module incorrectly using interactive mode. - Fix crash on Solaris when ps ucb variant is not available. (CFE-2506) - cf-serverd: Do not close connection when file does not exist. (CFE-2532) - getvalues() now behaves correctly for old CFEngine arrays of depth 1. Known issues: getvalues() still misbehaves with double-indexed arrays (see (CFE-2504, CFE-2536) 3.9.0: New features/additions: - Add optional interface parameter to iprange() to match only one interface. - Allow '=' in symbolic modes (Redmine #7826) - Add: FreeBSD ports package module - New package module for FreeBSD pkg package manager. - Add support for adding/removing fifos in policy - Add Linux parsing of /proc/net/ data. - sys.inet - sys.inet6 - sys.interface_data - Data is returned as a data container. - See documentation for more details. (Jira CFE-1991) - sys.ip2iface: new reverse mapping variable from IP to interface name - Namespaced classes can now be specified on the command line. - Namespaces can now be passed to cf-runagent -D and --remote-bundles (Redmine #7856) - Add 'cf-full' and 'json-full' to cf-promises '-p' option. They generate output based on the entire policy. The existing 'cf' already behaved this way, and it has now been changed to generate output only for a single file, which the existing 'json' option already does. - New language functions: processexists() and findprocesses() (Redmine #7633) - Implement new regex_replace() function. (Redmine #7346) - Add log rotation policy for state/classes.jsonl log. (Redmine #7951) - Added collect_vars utility bundle to stdlib - Intoduce report_class_log attribute to body agent control. (Redmine #7951) - Add standard_services service_method allowing for explicit usage - cf-promises --show-vars can now show JSON variables. - Add json_pipe mode to mapdata(), which allows piping a JSON container to an external program for manipulation and receiving JSON back. The jq tool is a good example where this mode can be useful. A corresponding $(def.jq) variable has also been added with a default path to this tool. See documentation for mapdata() for more information and examples. (Jira CFE-2071) - Behaviour change: "true" is always defined and "false" is never defined in a context expression. - Add: nimclient package module for AIX This module provides basic functionality for using nimclient as a means to ensure packages are either present or absent. It does not support listing package updates available or provide any special caching. - Add callstack_callers() and callstack_promisers() functions. - Log variable definitions in debug output. (Redmine #7137) - Add: Memory information to host info report (Jira CFE-1177) - In Mustache templates, one can now use {{#-top-}} and {{/-top-}} tags to iterate over the top level element in a container. (Redmine #6545) - Add network_connections() function that parses /proc/net - Provide new -w argument to override the workdir for testing - New feature: Emails sent by cf-execd can be filtered to get rid of emails for unwanted log messages. The attributes mailfilter_include and mailfilter_exclude in body executor control control what to include. See documentation for cf-execd for more information. (Jira CFE-2283) - Add: file_make_mustache bundle to render mustache templates - Add '-n' flag to cf-key to avoid host name lookups. - cf-agent, cf-execd, cf-promises, cf-runagent and cf-serverd honor multiple -D, -N and -s arguments (Redmine #7191) - Add "canonify" mode to mapdata(). - Add: printfile bodies to stdlib - Add: New results classes body [] (Redmine #7418, #7481) - Implement cf-runagent --remote-bundles and cf-serverd "bundle" access promise. (Redmine #7581) - Add commands promise arglist attribute, augmenting args attribute. - It's now possible to reference variables in inline JSON, for example: mergedata('[ thing, { "mykey": otherthing[123] } ]'). thing and otherthing[123] will be resolved as variables, since they are unquoted. See the documentation for more details. (Redmine #7871) - Allow inline JSON to be used in the following function calls: - data_expand() - difference() - every() - filter() - format() - getindices() - getvalues() - grep() - intersection() - join() - length() - makerule() - mapdata() - maplist() - mean() - mergedata() - none() - nth() - parsejson() - product() - regarray() - reglist() - reverse() - shuffle() - some() - sort() - storejson() - string_mustache() - sublist() - sum() - unique() - url_get() - variance() For example: mergedata('[ "thing", { "mykey": "myvalue" } ]') See the documentation for more details. (Jira CFE-2253) - Add: edit_line contains_literal_string to stdlib - Add body agent control select_end_match_eof option. (Jira CFE-2390) Changes: - Change: classesmatching(): order of classes changed - Change: getindices(), getvalues(), variablesmatching(), maparray(): order of variables returned has changed - Change: set_quoted_values uses bundle scoped classes - Change: set_config_values uses bundle scoped classes - Change: set_variable_values uses bundle scoped classes - Change: set_config_values_matching uses bundle scoped classes - Change: manage_variable_values_ini uses bundle scoped classes - Change: set_line_based should use bundle scoped classes (Jira CFE-1959) - getvalues() will now return a list also for data containers, and will descend recursively into the containers. (Redmine #7116) - Change: Improve git drop user support - Use new package promise as default package promise implementation. (Jira CFE-2332) - Don't follow symbolic links when copying extended attributes. - When a bodydefault: _ body is defined, it will be used by all promises of type unless another body is explicitly used. - cf-serverd no longer appends "-I -Dcfruncommand" to cfruncommand, this has to be done manually in masterfiles body server control. (Redmine #7732) - eval() function arguments mode and options are now optional. - sort() function argument mode is now optional. - Change: returnszero() no longer outputs the output of a command. The output can be seen by enabling info mode (-I). - cfruncommand is not executed under shell. (Redmine #7409) - Remove: Apache CGI module - Change: Make maxbytes arg of readjson() and readyaml() optional - Classes matching agent control's abortclasses are now printed before exit, even if they are defined in common bundles. Previously the regex (in abortclasses) that matched the class was printed if the class was defined in a common bundle, but the class itself was printed if it was defined in an agent bundle. With this change, the defined class that caused the abort is always printed. - Remove: Support for email settings from augments_file (Redmine #7682) - Change: set_variable_values_ini uses bundle scoped classes - findfiles() now skips relative paths. (Redmine #7981) - Clients connections using non TLS protocol are rejected by default. . (Jira CFE-2339) - Change: Policy files specified in the "inputs" section of def.json will no longer be auto-loaded. One has to refer to the which are using the "inputs" field inside def.json. (Redmine #7961) - Change: Separate binary details from policy update (Redmine #7662) - Add guard for binary upgrade during bootstrap (Redmine #7861) - Change: Modernize pkg module and package_method - Remove: Userdir apache module - filestat(path, "linktarget") now follows non-absolute links and returns full path of target. This introduces a change in behaviour. Here is an example: $ ls -l /bin/sh lrwxrwxrwx 1 root root 4 Jun 4 2015 /bin/sh -> dash Previously the filestat function would return "dash", and would also log an error that the file can not be read. Now it will return "/bin/dash" (or the final destination if it happens that /bin/dash is also a symlink). You can still get the previous behaviour by using filestat(path, "linktarget_shallow"). (Redmine #7404) - Define (bootstrap|failsafe)_mode during update.cf when triggerd from failsafe.cf (Redmine #7861) - Behavior change: The promise string of a processes promise now matches just the command line of each process instead of the line that is output by ps. This was done to reduce fragmentation between platforms, since ps is a very nonstandardized tool. (Jira CFE-2161) - Allowed namespace names made more strict, to disallow namespaces that cannot be reached. (Redmine #7903) - Behavior change: When using readintlist(), readreallist() or readstringlist(), parsing an empty file will no longer result in a failed function call, but instead an empty list. Failure to open the file will still result in a failed function call. - insert_lines is no longer implicitly matching EOF as end of the region if 'select_end' pattern is not matched . (Jira CFE-2263) - EOF is matched as an end of the region in edit_line promises only if 'select_end_match_eof' parameter is true. (Jira CFE-2263) Bug fixes: - Upgrade CFEngine dependencies to the following versions: - Curl 7.48.0 - libxml2 2.9.4 - LMDB 0.9.18 - OpenLDAP 2.4.44 - OpenSSL 1.0.2h - PCRE 8.38 (Jira ENT-2720) - Upgrade dependencies to latest minor versions. For Community / Enterprise: For Enterprise: - Fix bug which sometimes misparses user names in ps output. - Fix: Problem with git not dropping privileges soon enough - Allow def.json up to 5MB instead of 4K. - It is possible to edit the same value in multiple regions of one file. (Redmine #7460) - CFEngine on Windows no longer truncates log messages if the program in question is killed halfway through. - Fixed a bug which caused def.json not being able to define classes based on other hard classes. (Jira CFE-2333) - Change: Tighten Enterprise hub permissions (Jira ENT-2708) - Fix a regression which would sometimes cause "Permission denied" errors on files inside directories with very restricted permissions. (Redmine #7808) - Fix use-after-free in ArrayMap and HashMap (Redmine #7952) - Package repositories are no more hit every time package promise is evaluated on SUSE. - Fix a bug which sometimes caused package promises to be skipped with "XX Another cf-agent seems to have done this since I started" messages in the log, most notably in long running cf-agent runs (longer than one minute). (Redmine #7933) - TTY detection should be more reliable. (Redmine #7606) - cf-promises -p cf now produces valid CFEngine code (Redmine #7956) - Fix ps options for FreeBSD to check processes only in current host and not in jails - cf-runagent now properly supports multiple -D or -s arguments (Redmine #7191) - Fix: Work around impaired class definition from augments (Jira CFE-2333) - Fix "No such file or directory" LMDB error on heavily loaded hosts. (Jira CFE-2300) - Check for empty server response in RemoteDirList after decryption (Redmine #7908) - Small performance optimization when cf-execd scans emails before sending. - Fix handling of closed connections during transactions (Redmine #7926) - The core ps parsing engine used for processes promises has been rewritten from scratch, and should be more robust than before. (Jira CFE-2161) - Fix the lexer which could not handle empty newline(s) before a @endif. - groupexists() no longer fails to detect a group name starting with a digit. (Jira CFE-2351) - Fix HP-UX specific bug that caused a lot of log output to disappear. - Fix unresolved variable (Redmine #7931) - Change: Suppress standard services noise on SUSE (Redmine #6968) - Reduce verbosity of yum package module (Redmine #7485) - cf-runagent: Allow connections to localhost instead of failing silently. - Show errors regarding failure to copy extended attributes when doing a local file copy. Errors could happen when copying across two different mount points where the support for extended attributes is different between the mount points. - Fix classes being set because of hash collision in the implementation. (Redmine #7912) - Fix build failure on FreeBSD 7.1 (Redmine #7415) - Improve logging when managing setuid/setgid - Reduce verbosity of apt_get package module (Redmine #7485) - packagesmatching() and packageupdatesmatching() should work when new package promise is used. (Jira CFE-2246) - Fix bug which could render host unable to recover from a syntax error, even if failsafe.cf was utilized. This could happen if the file containing the syntax error was specified in the def.json special file. (Redmine #7961) - Prevent crash in cf-execd email code when policy server is not set. - In case of networking error, assume checksum is wrong - Fix two cases where action_policy warn still produces errors (Redmine #7274) - Fix bad option nlwp to vzps on Proxmox / OpenVZ. (Redmine #6961) - @if minimum_version now correctly ignores lines starting with '@' (Redmine #7862) - No longer hang when changing permissions/ownership on fifos (Redmine #7030) - readfile() and read*list() should print an error if they fail to read file. (Redmine #7702) - The isvariable() function call now correctly accepts all array variables when specified inline. Previously it would not accept certain special characters, even though they could be specified indirectly by using a variable to hold it. (Redmine #7088) - Fix file descriptor leak when there are network errors. - Improve robustness of process table parsing on Solaris. (Jira CFE-2161) - Installing packages containing version numbers using yum now works correctly. (Redmine #7825) - Parse def.json vars, classes and inputs from the C code. This fixes a bug where certain entries in this file would be parsed too late to have any effect on the evaluation. (Redmine #7453, #7615) - Change package modules permissions on hub package so that hub can execute package promises. (Redmine #7602) - Fix: CFEngine choking on standard services (Jira CFE-2086) - Fix: cf-upgrade on SUSE - Fix: Stop CFEngine choking on systemctl output (Jira CFE-2806) - storage: Properly initialize the list of current mounts (Jira CFE-1803) - Fix bug which caused empty emails to be sent from cf-execd if there was no previous output log and the new log was fully filtered by email filters. (Jira ENT-2739) - Don't send empty emails for logs where everything is filtered. (Jira ENT-2739) - Fix intermittent error message of type: "error: Process table lacks space for last columns: " (Jira CFE-2371) - Be less verbose if a network interface doesn't have a MAC address. (Jira CFE-1995) 3.8.2: Fixes: - Update library dependencies to latest version. Libraries upgraded: - curl 7.47.0 - LMDB 0.9.18 - MySQL 5.1.72 - OpenLDAP 2.4.44 - OpenSSL 1.0.2g - PostgreSQL 9.3.11 - Redis 3.0.7 - rsync 3.1.2 PHP was kept at 5.6.17 because of problems with the 5.6.19 version. - Reduce verbosity of apt_get package module (Redmine #7485) - Reduce verbosity of yum package module (Redmine #7485) - The isvariable() function call now correctly accepts all array variables when specified inline. Previously it would not accept certain special characters, even though they could be specified indirectly by using a variable to hold it. (Redmine #7088) - Don't follow symbolic links when copying extended attributes. - Fix a bug which sometimes caused package promises to be skipped with "XX Another cf-agent seems to have done this since I started" messages in the log, most notably in long running cf-agent runs (longer than one minute). (Redmine #7933) - Fix bug which could render host unable to recover from a syntax error, even if failsafe.cf was utilized. This could happen if the file containing the syntax error was specified in the def.json special file. (Redmine #7961) - Change: Policy files specified in the "inputs" section of def.json will no longer be auto-loaded. One has to refer to the $(def.augments_inputs) variable in the policy (the standard masterfiles policies include this by default). This only affects installations which are not based on the standard masterfiles, and which are using the "inputs" field inside def.json. (Redmine #7961) - Fix file descriptor leak when there are network errors. - Fix cf-serverd error messages with classic protocol clients (Redmine #7818) - Installing packages containing version numbers using yum now works correctly. (Redmine #7825) - Fix ps options for FreeBSD to check processes only in current host and not in jails - Fix build failure on FreeBSD 7.1 (Redmine #7415) - Show errors regarding failure to copy extended attributes when doing a local file copy. Errors could happen when copying across two different mount points where the support for extended attributes is different between the mount points. - Fix classes being set because of hash collision in the implementation. (Redmine #7912) - Allow def.json up to 5MB instead of 4K. - Fix a regression which would sometimes cause "Permission denied" errors on files inside directories with very restricted permissions. (Redmine #7808) - Change: Suppress standard services noise on SUSE (Redmine #6968) Changes: - Change: classesmatching(): order of classes changed 3.8.1: Changes: - Upgrade CFEngine dependencies to the following versions: - OpenSSL 1.0.2e - PCRE 8.38 - libxml2 2.9.3 - OpenLDAP 2.4.43 - libcurl 7.46.0 - Upgrade LMDB to version 0.9.17. (Redmine #7879) Bug fixes: - @if minimum_version now correctly ignores lines starting with '@' (Redmine #7862) - Add guard for binary upgrade during bootstrap (Redmine #7861) - Namespaced classes can now be specified on the command line. - Fix bad option nlwp to vzps on Proxmox / OpenVZ. (Redmine #6961) - Fix two cases where action_policy warn still produces errors (Redmine #7274) - Parse def.json vars, classes and inputs from the C code. This fixes a bug where certain entries in this file would be parsed too late to have any effect on the evaluation. (Redmine #7453, #7615) - Fix HP-UX specific bug that caused a lot of log output to disappear. - Check for empty server response in RemoteDirList after decryption (Redmine #7908) - getvalues() will now return a list also for data containers, and will descend recursively into the containers. (Redmine #7116) - Define (bootstrap|failsafe)_mode during update.cf when triggerd from failsafe.cf (Redmine #7861) 3.8.0: New features/additions: - New feature: Bodies can now inherit attribute values from other bodies by specifying "inherit_from" with the name of the body to inherit from, plus any arguments it accepts. For example: body classes myclasses { inherit_from => classes_generic("myname"); } (Redmine #4309) - Add url_get() function. (Redmine #6480) - Add @if feature() syntax @if feature work like @if minimum_version but allows distinguishing between features chosen at compile time. - Extend module protocol to create persistent classes. To use it, have the module print a line with "^persistence= " before printing any class names. "persistence=0" goes back to non- persistent classes. (Redmine #7302) - Add: New results classes body (Redmine #7418) - Add: Debug reports in cfe_internal_cleanup_agent_reports - Add: Path to svcprop in stdlib - Add: masterfiles-stage script to contrib - Whitespace is now allowed in class expressions for readability, between class names and operators. (Redmine #7152) Changes: - Change: Clarify bootstrap/failsafe reports - Change: Improve in-line docs for internal log maintenance - Change: Improve efficiency and debug reports (Redmine #7527) - Remove: 3.5 support from masterfiles policy framework - Long promiser strings with multiple lines are now abbreviated in logs. (Redmine #3964) - Change: Reunify Version based policy split - Change: Separate binary details from policy update (Redmine #7662) - Remove /var/cfengine/cf3. .runlog. (Redmine #6957) - Change: sys.libdir and sys.local_libdir to non version specific path - sys.libdir now resolves to $(sys.inputdir)/lib - sys.local_libdir now resolves to lib (Redmine #7559) - Moved the following files to /var/cfengine/log/: - /var/cfengine/promise_summary.log - /var/cfengine/cfagent. .log - Change: Separate binary details from policy update (Redmine #7662) - Remove: Support for email settings from augments_file (Redmine #7682) Bug fixes: - It is possible to edit the same value in multiple regions of one file. (Redmine #7460) - Change package modules permissions on hub package so that hub can execute package promises. (Rednime #7602) (Redmine #7602) - Fix exporting CSV reports through HTTPS. (Redmine #7267) - cf-agent, cf-execd, cf-promises, cf-runagent and cf-serverd honor multiple -D, -N and -s arguments (Redmine #7191) - readfile() and read*list() should print an error if they fail to read file. (Redmine #7702) - No longer hang when changing permissions/ownership on fifos (Redmine #7030) - Fix broken HA policy for 3rd disaster-recovery node. - Fix: Policy errors for 3.5 and 3.6 - Mustache templates: Fix {{@}} key when value is not a primitive. The old behavior, when iterating across a map or array of maps, was to abort if the key was requested with {{@}}. The new behavior is to always replace {{@}} with either the key name or the iteration position in the array. An error is printed if {{@}} is used outside of a Mustache iteration section. - Fix build with musl libc. (Redmine #7455) - Fixed a bug which could cause daemons to not to be killed correctly when upgrading or manually running "service cfengine3 stop". (Redmine #7193) - Fix daemons not restarting correctly on upgrade on AIX. - Package promise: Fix inability to install certain packages with numbers. (Redmine #7421) - Redmine #6027 Directories should no more be changed randomly into files. (Redmine #6027) - Improve cf-serverd's lock contention because of getpwnam() call. (Redmine #7643) (Redmine #7643) - action_policy "warn" now correctly produces warnings instead of various other verbosity levels. (Redmine #7274) - If there is an error saving a mustache template file it is now logged with log-level error (was inform). - The JSON parser now supports unquoted strings as keys. - Reduce malloc() thread contention on heavily loaded cf-serverd, by not exiting early in the logging function, if no message is to be printed. (Redmine #7624) (Redmine #7624) - Fix a bug which caused daemons not to be restarted on upgrade. (Redmine #7528) - Include latest security updates for dependencies. - Fixed bug which would cause bff and depot packages not to run package scripts on removal. (Redmine #7193) - Fix upgrade causing error message under systemd because of open ports. - Fixed several bugs which prevented CFEngine from loading libraries from the correct location. This affected several platforms. (Redmine #6708) - Legacy package promise: Result classes are now defined if the package being promised is already up to date. (Redmine #7399) - failsafe.cf will be created when needed. (Redmine #7634) (Redmine #7634) - If file_select.file_types is set to symlink and there are regular files in the scanned directory, CFEngine no longer produces an unnecessary error message. (Redmine #6996) - Fix 'AIX_PREINSTALL_ALREADY_DONE.txt: cannot create' error message on AIX. - Fix package promise not removing dependent packages. (Redmine #7424) - Fix: Solaris packages no longer contain duplicate library files, but instead symlinks to them. (Redmine #7591) - Fix select_class not setting class when used in common bundle with slist. (Redmine #7482) - Fix "@endif" keyword sometimes being improperly processed by policy parser. (Redmine #7413) - Fix noise from internal policy to upgrade windows agents (Redmine #7456) - cfruncommand now works if it contains spaces, with the TLS protocol. (Redmine #7405) - Fix warning "Failed to parse csv file entry" with certain very long commands promises. (Redmine #7400) - CFEngine no longer erronously passes -M to useradd on HP-UX. (Redmine #6734) - cf-monitord no longer complains about missing thermal zone files. (Redmine #7238) - systemd is now detected correctly if it is a symlink (Redmine #7297) - TTY detection should be more reliable. (Redmine #7606) (Redmine #7606) 3.7.3 Fixes: - Reduce verbosity of yum package module (Redmine #7485) - Reduce verbosity of apt_get package module (Redmine #7485) - Upgrade dependencies to latest patch versions. Upgraded libraries: - curl 7.47.0 - libxml2 2.9.3 - LMDB 0.9.18 - MySQL 5.1.72 - OpenLDAP 2.4.44 - OpenSSL 1.0.2g - PCRE 8.38 - PostgreSQL 9.3.11 - Redis 2.8.24 - rsync 3.1.2 PHP was kept at 5.6.17 because of problems with the 5.6.19 version. - Parse def.json vars, classes, and inputs in C (Redmine #7453) - Namespaced classes can now be specified on the command line. - getvalues() will now return a list also for data containers, and will descend recursively into the containers. (Redmine #7116) - @if minimum_version now correctly ignores lines starting with '@' (Redmine #7862) - Fix definition of classes from augments file - Don't follow symbolic links when copying extended attributes. - Fix ps options for FreeBSD to check processes only in current host and not in jails - Fix cf-serverd error messages with classic protocol clients (Redmine #7818) - Change: Suppress standard services noise on SUSE (Redmine #6968) - The isvariable() function call now correctly accepts all array variables when specified inline. Previously it would not accept certain special characters, even though they could be specified indirectly by using a variable to hold it. (Redmine #7088) - Show errors regarding failure to copy extended attributes when doing a local file copy. Errors could happen when copying across two different mount points where the support for extended attributes is different between the mount points. - Fix bad option nlwp to vzps on Proxmox / OpenVZ. (Redmine #6961) - Fix file descriptor leak when there are network errors. - Fix a regression which would sometimes cause "Permission denied" errors on files inside directories with very restricted permissions. (Redmine #7808) - Check for empty server response in RemoteDirList after decryption (Redmine #7908) - Allow def.json up to 5MB instead of 4K. - Add guard for binary upgrade during bootstrap (Redmine #7861) - Fix HP-UX specific bug that caused a lot of log output to disappear. - Fix a bug which sometimes caused package promises to be skipped with "XX Another cf-agent seems to have done this since I started" messages in the log, most notably in long running cf-agent runs (longer than one minute). (Redmine #7933) - Define (bootstrap|failsafe)_mode during update.cf when triggerd from failsafe.cf (Redmine #7861) - Fix two cases where action_policy warn still produces errors (Redmine #7274) - Fix classes being set because of hash collision in the implementation. (Redmine #7912) - Fix build failure on FreeBSD 7.1 (Redmine #7415) - Installing packages containing version numbers using yum now works correctly. (Redmine #7825) Changes: - Change: classesmatching(): order of classes changed 3.7.3 Fixes: - Reduce verbosity of yum package module (Redmine #7485) - Reduce verbosity of apt_get package module (Redmine #7485) - Upgrade dependencies to latest patch versions. Upgraded libraries: - curl 7.47.0 - libxml2 2.9.3 - LMDB 0.9.18 - MySQL 5.1.72 - OpenLDAP 2.4.44 - OpenSSL 1.0.2g - PCRE 8.38 - PostgreSQL 9.3.11 - Redis 2.8.24 - rsync 3.1.2 PHP was kept at 5.6.17 because of problems with the 5.6.19 version. - Parse def.json vars, classes, and inputs in C (Redmine #7453) - Namespaced classes can now be specified on the command line. - getvalues() will now return a list also for data containers, and will descend recursively into the containers. (Redmine #7116) - @if minimum_version now correctly ignores lines starting with '@' (Redmine #7862) - Fix definition of classes from augments file - Don't follow symbolic links when copying extended attributes. - Fix ps options for FreeBSD to check processes only in current host and not in jails - Fix cf-serverd error messages with classic protocol clients (Redmine #7818) - Change: Suppress standard services noise on SUSE (Redmine #6968) - The isvariable() function call now correctly accepts all array variables when specified inline. Previously it would not accept certain special characters, even though they could be specified indirectly by using a variable to hold it. (Redmine #7088) - Show errors regarding failure to copy extended attributes when doing a local file copy. Errors could happen when copying across two different mount points where the support for extended attributes is different between the mount points. - Fix bad option nlwp to vzps on Proxmox / OpenVZ. (Redmine #6961) - Fix file descriptor leak when there are network errors. - Fix a regression which would sometimes cause "Permission denied" errors on files inside directories with very restricted permissions. (Redmine #7808) - Check for empty server response in RemoteDirList after decryption (Redmine #7908) - Allow def.json up to 5MB instead of 4K. - Add guard for binary upgrade during bootstrap (Redmine #7861) - Fix HP-UX specific bug that caused a lot of log output to disappear. - Fix a bug which sometimes caused package promises to be skipped with "XX Another cf-agent seems to have done this since I started" messages in the log, most notably in long running cf-agent runs (longer than one minute). (Redmine #7933) - Define (bootstrap|failsafe)_mode during update.cf when triggerd from failsafe.cf (Redmine #7861) - Fix two cases where action_policy warn still produces errors (Redmine #7274) - Fix classes being set because of hash collision in the implementation. (Redmine #7912) - Fix build failure on FreeBSD 7.1 (Redmine #7415) - Installing packages containing version numbers using yum now works correctly. (Redmine #7825) Changes: - Change: classesmatching(): order of classes changed 3.7.2: Bug fixes: - readfile() and read*list() should print an error if they fail to read file. (Redmine #7702) - Fix 'AIX_PREINSTALL_ALREADY_DONE.txt: cannot create' error message on AIX. - If there is an error saving a mustache template file it is now logged with log-level error (was inform). - Change: Clarify bootstrap/failsafe reports - Fixed several bugs which prevented CFEngine from loading libraries from the correct location. This affected several platforms. (Redmine #6708) - If file_select.file_types is set to symlink and there are regular files in the scanned directory, CFEngine no longer produces an unnecessary error message. (Redmine #6996) - Fix: Solaris packages no longer contain duplicate library files, but instead symlinks to them. (Redmine #7591) - cf-agent, cf-execd, cf-promises, cf-runagent and cf-serverd honor multiple -D, -N and -s arguments (Redmine #7191) - Fix "@endif" keyword sometimes being improperly processed by policy parser. (Redmine #7413) - It is possible to edit the same value in multiple regions of one file. (Redmine #7460) - Fix select_class not setting class when used in common bundle with slist. (Redmine #7482) - Fix broken HA policy for 3rd disaster-recovery node. - Directories should no more be changed randomly into files. (Redmine #6027) - Include latest security updates for 3.7. - Reduce malloc() thread contention on heavily loaded cf-serverd, by not exiting early in the logging function, if no message is to be printed. (Redmine #7624) - Improve cf-serverd's lock contention because of getpwnam() call. (Redmine #7643) - action_policy "warn" now correctly produces warnings instead of various other verbosity levels. (Redmine #7274) - Change: Improve efficiency and debug reports (Redmine #7527) - Change package modules permissions on hub package so that hub can execute package promises. (Redmine #7602) - No longer hang when changing permissions/ownership on fifos (Redmine #7030) - Fix exporting CSV reports through HTTPS. (Redmine #7267) - failsafe.cf will be created when needed. (Redmine #7634) - Mustache templates: Fix {{@}} key when value is not a primitive. The old behavior, when iterating across a map or array of maps, was to abort if the key was requested with {{@}}. The new behavior is to always replace {{@}} with either the key name or the iteration position in the array. An error is printed if {{@}} is used outside of a Mustache iteration section. - Legacy package promise: Result classes are now defined if the package being promised is already up to date. (Redmine #7399) - TTY detection should be more reliable. (Redmine #7606) Masterfiles: - Add: Path to svcprop in stdlib - Add: New results classes body [] (Redmine #7418, #7481) - Remove: Support for email settings from augments_file (Redmine #7682) 3.7.1: Bug fixes: - Fix daemons not restarting correctly on upgrade on AIX. (Redmine #7550) - Fix upgrade causing error message under systemd because of open ports. - Fix build with musl libc. (Redmine #7455) - Long promiser strings with multiple lines are now abbreviated in logs. (Redmine #3964) - Fixed a bug which could cause daemons to not to be killed correctly when upgrading or manually running "service cfengine3 stop". (Redmine #7193) - Package promise: Fix inability to install certain packages with numbers. - Fix package promise not removing dependent packages. (Redmine #7424) - Fix warning "Failed to parse csv file entry" with certain very long commands promises. (Redmine #7400) - Fix misaligned help output in cf-hub. (Redmine #7273) - Augmenting inputs from the augments_file (Redmine #7420) - Add support for failover to 3rd HA node located outside cluster. - Upgrade all dependencies for patch release. - Fix a bug which caused daemons not to be restarted on upgrade. (Redmine #7528) 3.7.0: New features: - New package promise implementation. The syntax is much simpler, to try it out, check out the syntax: packages: "mypackage" policy => "absent/present", # Optional, default taken from common control package_module => apt_get, # Optional, will only match exact version. May be # "latest". version => "32.0", # Optional. architecture => "x86_64"; - Full systemd support for all relevant platforms - New classes to determine whether certain features are enabled: * feature_yaml * feature_xml For the official CFEngine packages, these are always enabled, but packages from other sources may be built without the support. - New readdata() support for generic data input (CSV, YAML, JSON, or auto) - YAML support: new readyaml() function and in readdata() - CSV support: new readcsv() function and in readdata() - New string_mustache() function - New data_regextract() function - eval() can now be called with "class" as the "mode" argument, which will cause it to return true ("any") if the calculated result is non-zero, and false ("!any") if it is zero. - New list_ifelse() function - New mapdata() function as well as JSON support in maparray(). - filestat() function now supports "xattr" argument for extended attributes. - "ifvarclass" now has "if" as an alias, and "unless" as an inverse alias. - Ability to expand JSON variables directory in Mustache templates: Prefix the name with '%' for multiline expansion, '$' for compact expansion. - Ability to expand the iteration *key* in Mustache templates with @ - Canonical JSON output: JSON output has reliably sorted keys so the same data structure will produce the same JSON every time. - New "@if minimum_version(x.x)" syntax in order to hide future language improvements from versions that don't understand them. - Compile time option (--with-statedir) to override the default state/ directory path. - Fix error messages/ handling in process signalling which no longer allowed any signals to fail silently - Also enable shortcut keyword for cf-serverd classic protocol, eg to simplify the bootstrap process for clients that have different sys.masterdir settings (Redmine #3697) - methods promises now accepts the bundle name in the promiser string, as long as it doesn't have any parameters. - In a services promise, if the service_method bundle is not specified, it defaults to the promiser string (canonified) with "service_" as a prefix. The bundle must be in the same namespace as the promise. - Inline JSON in policy files: surrounding with parsejson() is now optional *when creating a new data container*. - New data_expand() function to interpolate variables in a data container. - Add configurable network bandwidth limit for all outgoing connections ("bwlimit" attribute in "body common control") . To enforce it in both directions, make sure the attribute is set on both sides of the connection. - Secure bootstrap has been facilitated by use of "cf-agent --boostrap HUB_ADDRESS --trust-server=no" - Implement new TLS-relevant options (Redmine #6883): - body common control: tls_min_version - body server control: allowtlsversion - body common control: tls_ciphers - body server control: allowciphers (preexisting) Changes: - Improved output format, less verbose, and messages are grouped. - cf-execd: agent_expireafter default was changed to 120 minutes (Redmine #7113) - All embedded databases are now rooted in the state/ directory. - TLS used as default for all outgoing connections. - process promise now reports kept status instead of repaired if a signal is not sent, even if the restart_class is set. The old behavior was to set the repaired status whenever the process was not running. (Redmine#7216). - Bootstrapping requires keys to be generated in advance using cf-key. - Disable class set on reverse lookup of interfaces IP addresses. (Redmine #3993, Redmine #6870) - Define a hard class with just the OS major version on FreeBSD. - Abort cf-agent if OpenSSL's random number generator can't be seeded securely. - Masterfiles source tarball now installs using the usual commands "./configure; make install". - Updated Emacs syntax highlighting template to support the latest syntax enhancements in 3.7. Deprecations: - Arbitrary arguments to cfruncommand (using "cf-runagent -o") are not acceptable any more. (Redmine #6978) - 3.4 is no longer supported in masterfiles. Bug fixes: - Fix server common bundles evaluation order (Redmine#7211). - Limit LMDB disk usage by preserving sparse areas in LMDB files (Redmine#7242). - Fixed LMDB corruption on HP-UX 11.23. (Redmine #6994) - Fixed insert_lines failing to converge if preserve_block was used. (Redmine #7094) - Fixed init script failing to stop/restart daemons on openvz/lxc hosts. (Redmine #3394) - rm_rf_depth now deletes base directory as advertised. (Redmine #7009) - Refactored cf-agent's connection cache to properly differentiate hosts using all needed attributes like host and port. (Redmine #4646) - Refactored lastseen database handling to avoid inconsistencies. (Redmine #6660) - cf-key --trust-key now supports new syntax to also update the lastseen database, so that clients using old protocol will trust the server correctly. - Fixed a bug which sometimes caused an agent or daemon to kill or stop itself. (Redmine #7075, #7244) - Fixed a bug which made it difficult to kill CFEngine daemons, particularly cf-execd. (Redmine #6659, #7193) - Fixed a bug causing systemd not to be detected correctly on Debian. (Redmine #7297) - "cf-promises -T" will now correctly report the checked out commit, even if you haven't checked out a Git branch. (Redmine #7332) - Reduce verbosity of harmless errors related to socket timeouts and missing thermal zone files. (Redmine #6486 and #7238) Masterfiles: Added: - Support for user specified overring of framework defaults without modifying policy supplied by the framework itself (see example_def.json) - Support for def.json class augmentation in update policy - Run vacuum operation on postgresql every night as a part of maintenance. - Add measure_promise_time action body to lib (3.5, 3.6, 3.7, 3.8) - New negative class guard cfengine_internal_disable_agent_email so that agent email can be easily disabled by augmenting def.json Changed: - Relocate def.cf to controls/VER/ - Relocate update_def to controls/VER - Relocate all controls to controls/VER - Only load cf_hub and reports.cf on CFEngine Enterprise installs - Relocate acls related to report collection from bundle server access_rules to controls/VER/reports.cf into bundle server report_access_rules - Re-organize cfe_internal splitting core from enterprise specific policies and loading the appropriate inputs only when necessary - Moved update directory into cfe_internal as it is not generally intended to be modified - services/autorun.cf moved to lib/VER/ as it is not generally intended to be modified - To improve predictibility autorun bundles are activated in lexicographical order - Relocate services/file_change.cf to cfe_internal/enterprise. This policy is most useful for a good OOTB experience with CFEngine Enterprise Mission Portal. - Relocate service_catalogue from promsies.cf to services/main.cf. It is intended to be a user entry. This name change correlates with the main bundle being activated by default if there is no bundlesequence specified. - Reduce benchmarks sample history to 1 day. - Update policy no longer generates a keypair if one is not found. (Redmine: #7167) - Relocate cfe_internal_postgresql_maintenance bundle to lib/VER/ - Set postgresql_monitoring_maintenance only for versions 3.6.0 and 3.6.1 - Move hub specific bundles from lib/VER/cfe_internal.cf into lib/VER/cfe_internal_hub.cf and load them only if policy_server policy if set. - Re-organize lib/VER/stdlib.cf from lists into classic array for use with getvalues Removed: - Diff reporting on /etc/shadow (Enterprise) - Update policy from promise.cf inputs. There is no reason to include the update policy into promsies.cf, update.cf is the entry for the update policy - _not_repaired outcome from classes_generic and scoped_classes generic (Redmine: # 7022) Fixes: - standard_services now restarts the service if it was not already running when using service_policy => restart with chkconfig (Redmine #7258) 3.6.5: Features: - Introduced "systemd" hard class. (Redmine #6995) - Added paths to dtrace, zfs and zpool on FreeBSD in masterfiles. Bug fixes: - Fixed build error on certain RHEL5 and SLES10 setups. (Redmine #6841) - Fixed a bug which caused dangling symlinks not to be removed. (Redmine #6582) - Fixed data_readstringarrayidx function not preserving the order of the array it's producing. (Redmine #6920) - Fixed a bug which sometimes caused CFEngine to kill the wrong daemon if both the host and a container inside the host were running CFEngine. (Redmine #6906) - Made sure the rm_rf_depth bundle also deletes the base directory. (Redmine #7009) - Fixed monitord reporting wrongly on open ports. (Redmine #6926) - Skip adding the class when its name is longer than 1024 characters. Fixed core dump when the name is too large. (Redmine #7013) - Fixed detection of stopped process on Solaris. (Redmine #6946) - Fixed infinite loop (Redmine #6992) plus a couple more minor bugs in edit_xml promises. 3.6.4: Features: - Introduced users promises support on HP-UX platform. - Introduced process promises support on HP-UX platform. Bug fixes: - Fixed bug on FreeBSD which sometimes led to the wrong process being killed (Redmine #2330) - Fixed package version comparison sometimes failing with rpm package manager (Redmine #6807) - Fixed a bug in users promises which would sometimes set the wrong password hash if the user would also be unlocked at the same time. - Fixed a bug on AIX which would occasionally kill the wrong process. - Improved error message for functions that require an absolute path. (Redmine #6877) - Fixed some spelling errors in examples. - Fixed error in out-of-tree builds when building cf-upgrade. - Fixed a bug which would make cf-agent exit with an error if it was built with a custom log directory, and that directory did not exist. - Fixed ordering of evaluating promises when depends_on is used. (Redmine #6484, Redmine #5462) - Skip non-empty directories silently when recursively deleting. (Redmine #6331) - Fix memory exhaustion with list larger than 4994 items. (Redmine # 6672) - Fix cf-execd segfault on IP address detection (Redmine #6905). - Fix hard class detection of RHEL6 ComputeNode (Redmine #3148). 3.6.3 New features: - Support for HP-UX 11.23 and later - Experimental support for Red Hat Enterprise Linux 7 Bug fixes: - Fix getindices on multi-dimensional arrays (Redmine #6779) - Fix mustache template method to run in dryrun mode (Redmine #6739) - Set mailto and mailfrom settings for execd in def.cf (Redmine #6702) - Fix conflation of multi-index entries in arrays (Redmine #6674) - Fix promise locking when transferring using update.cf (Redmine #6623) - Update JSON parser to return an error on truncation (Redmine #6608) - Fix sys.hardware_addresses not expanded (Redmine #6603) - Fix opening database txn /var/cfengine/cf_lastseen.lmdb: MDB_READERS_FULL when running cf-keys --show-hosts (Redmine #6602) - Fix segfault (Null pointer dereference) when select_end in delete_lines never matches (Redmine #6589) - Fix max_file_size => "0" not disabling or allowing any size (Redmine #6588) - Fix ifvarclass, with iteration over list, failing when deleting files with time condition (Redmine #6577) - Fix classes defined with "or" constraint are never set if any value doesn't evaluate to a scalar (Redmine #6569) - Update "mailfrom" default in default policy (Redmine #6567) - Fix logrotate ambiguity of filename (Redmine #6563) - Fix parsing JSON files (Redmine #6549) - Reduce write count activity to /var partition (Redmine #6523) - Fix files delete attribute incorrectly triggering promise_kept (Redmine #6509) - Update services bundle output related to chkconfig when run in inform mode. (Redmine #6492) - Fix Solaris serverd tests (Redmine #6406) - Fix broken bechaviour of merging arrays with readstringarray (Redmine #6369) - Fix ifelapsed bug with bundle nesting (Redmine #6334) - Fix handling cf_null in bundlesequence (Redmine #6119) - Fix maparray reading whole input array when using subarray (Redmine #6033) - Fix directories being randomly changed to files (Redmine #6027) - Update defaults promise type to work with classes (Redmine #5748) - systemd integration in services promises (Redmine #5415) - Fix touch attribute ignoring action = warn_only (Redmine #3172) - Fix 4KB string limit in functions readfile, string_downcase, string_head, string_reverse, string_length, string_tail, string_upcase (Redmine #2912) 3.6.2 Bug fixes: - Don't regenerate software_packages.csv every time (Redmine #6441) - Improve verbose message for package_list_command - Fix missing log output on AIX (Redmine #6434) - Assorted fixes to dirname() esp on Windows (Redmine #4716) - Fix package manager detection - Fix build issues on FreeBSD - Allow copying of dead symbolic links (Redmine #6175) - Preserve order in readstringarrayidx (Redmine #6466) - Fix passing of unexpanded variable references to arrays (Redmine #5893) - Use entries for new {admin,deny}_{ips,hostnames} constraints in the relevant legacy lists (Redmine #6542) - Cope with ps's numeric fields overflowing to the right - Interpret failing function calls in ifvarclass as class not set (Redmine #6327) - Remove unexpanded lists when extending lists (Redmine #6541) - Infer start-time of a process from elapsed when needed (Redmine #4094) - Fix input range definition for laterthan() function (Redmine #6530) - Don't add trailing delimiter when join()'ing lists ending with a null-value (Redmine #6552) - 9999999999 (ten 9s) or higher has been historically used as an upper bound in CFEngine code and policy but because of overflow on 32-bit platforms it caused problems with big numbers. Fixed in two ways: first change all existing policy uses to 999999999 (nine 9s instead of eleven 9s), second fix the C code to not wrap-around in case of overflow, but use the LONG_MAX value (Redmine #6531). - cf-serverd and other daemons no longer reload their configuration every minute if CFEngine is built with an inputs directory outside of the work directory (not the default). (Redmine #6551) 3.6.1 New features: - Introduced Solaris and AIX support into the 3.6 series, with many associated build and bug fixes. Changes: - Short-circuit evaluation of classes promises if class is already set (Redmine #5241) - Fix to assume all non-specified return codes are failed in commands promises (Redmine #5986) - cf-serverd logs reconfiguration message to NOTICE (was INFO) so that it's always logged in syslog Bug fixes: - File monitoring has been completely rewritten (changes attribute in files promise), which eliminates many bugs, particularly regarding files that are deleted. Upgrading will keep all monitoring data, but downgrading again will reinitialize the DB, so all files will be reported as if they were new. (Redmine #2917) - $(this.promiser) expands in files promises for 'transformer', 'edit_template', 'copy_from.source', 'file_select.exec_program', 'classes' and 'action' bodies (Redmine #1554, #1496, #3530, #1563) - 'body changes' notifies about disappeared files in file monitoring (Redmine #2917) - Fixed CFEngine template producing a zero sized file (Redmine #6088) - Add 0-9 A-Z _ to allowed context of module protocol (Redmine #6063) - Extend ps command column width and prepend zone name on Solaris - Fixed strftime() function on Solaris when called with certain specifiers. - Fixed users promise bug regarding password hashes in a NIS/NSS setup. - Fixed $(sys.uptime), $(sys.systime) and $(sys.sysday) in AIX. (Redmine #5148, #5206) - Fixed processes_select complaining about "Unacceptable model uncertainty examining processes" (Redmine #6337) - ps command for linux has been changed to cope with big rss values (Redmine #6337) - Address ps -axo shift on FreeBSD 10 and later (Redmine #5667) - methods and services promises respect action_policy => "warn" (Redmine #5924) - LMDB should no longer deadlock if an agent is killed on the hub while holding the DB lock. Note that the change only affects binary packages shipped by CFEngine, since the upstream LMDB project has not yet integrated the change. (Redmine #6013) 3.6.0 Changes: - Changes to logging output - Add process name and pid in syslog message (GitHub #789) - cf-serverd logging levels are now more standardised: - INFO logs only failures - VERBOSE logs successful requests as well - DEBUG logs actual protocol traffic. - cf-serverd now logs the relevant client IP address on each message. - Logging contexts to local database (cf_classes.tcdb) has been deprecated. - 'usebundle' promisees are logged for all the bundle promises - output from 'reports' promises has nothing prefixed except 'R: ' - a log line with stack path is generated when the promise type evaluated changes - LMDB (symas.com/mdb) is the default database for local data storage : use version 0.9.9 or later cf-agent --self-diagnostics (-x) is only implemented for TCDB, not for LMDB - port argument in readtcp() and selectservers() may be a service name (e.g. "http", "pop3"). - Enable source file in agent copy_from promises to be a relative path. - file "changes" reporting now reports with log level "notice", instead of "error". - process_results default to AND'ing of set attributes if not specified (Redmine #3224) - interface is now canonified in sys.hardware_mac[interface] to align with sys.ipv4[interface] (Redmine #3418) - cf-promises no longer errors on missing bodies when run without --full-check (-c) - Linux flavor "SUSE" now correctly spelled with all uppercase in variables and class names (Redmine #3734). The "suse" lowercase version is also provided for convenience (Redmine #5417). - $(this.promise_filename) and $(..._dirname) variables are now absolute paths. (Redmine #3839) - Including the same file multiple times in 'body control inputs' is not an error - portnumber in body copy_from now supports service names like "cfengine", "pop3" etc, check /etc/services for more. - The failsafe.cf policy, run on bootstrap and in some other unusual cases, has been extracted from C code into libpromises/failsafe.cf - masterfiles - cf_promises_validated is now in JSON format - timestamp key is timestamp (sec since unix epoch) of last time validated - the masterfiles now come from https://github.com/cfengine/masterfiles and are not in the core repository - cf-serverd calls cf-agent with -Dcfruncommand when executing cf-runagent requests - Mark as removed: promise_notkept_log_include, promise_notkept_log_exclude, promise_repaired_log_include, promise_repaired_log_exclude, classes_include, classes_exclude, variables_include, variables_exclude attributes from report_data_select body (syntax is valid but not functional). They have been replaced by the following attributes: promise_handle_include, promise_handle_exclude, metatags_include, metatags_exclude. New features: - New promise type "users" for managing local user accounts. - TLS authentication and fully encrypted network protocol. Additions specific to the new type of connections: - New attribute "allowlegacyconnects" in body server control, which enables serving policy via non-latest CFEngine protocol, to the given list of hosts. If the option is absent, it defaults to allow all hosts. To refuse non-TLS connections, specify an empty list. - New attribute "protocol_version" in body copy_from, and body common control, which defines the preferred protocol for outgoing connections.. Allowed values at the moment: "0" or "undefined", "classic" or "1", "latest" or "2". By leaving the copy_from option as undefined the common control option is used, and if both are undefined then classic protocol is used by default. - The new networking protocol uses TLS for authentication, after which all dialog is encrypted within the established TLS session. cf-serverd is still able to speak the legacy protocol with old agents. - The 'skipverify' option in 'body server control' is deprecated and only left for compatibility; it does nothing - cf-serverd does not hang up the connection if some request fails, so that the client can add more requests. - For the connections using the new protocol, all of the paths in bundle server access_rules now differentiate between a directory and a file using the trailing slash. If the path exists then this is auto-detected and trailing slash appended automatically. You have to append a trailing slash manually to an inexistent or symbolic path (e.g. "/path/to/$(connection.ip)/") to force recursive access. - New in 'access' promises for 'bundle server access_rules' - Attributes "admit_ips", "admit_hostnames", "admit_keys", "deny_ips", "deny_hostnames", "deny_keys" - "admit_keys" and "deny_keys" add the new functionality of controlling access according to host identity, regardless of the connecting IP. - For these new attributes, regular expressions are not allowed, only CIDR notation for "admit/deny_ips", exact "SHA=..." strings for "admit/deny_keys", and exact hostnames (e.g. "cfengine.com") or subdomains (starting with dot, e.g. ".cfengine.com") for "admit/deny"_hostnames. Same rules apply to 'deny_*' attributes. - These new constraints and the paths in access_rules, can contain special variables "$(connection.ip)", "$(connection.hostname)", "$(connection.key)", which are expanded dynamically for every received connection. - For connections using the new protocol, "admit" and "deny" constraints in bundle server access_rules are being phased out, preferred attributes are now "admit_ips", "deny_ips", "admit_hostnames", "deny_hostnames", "admit_keys", "deny_keys". - New "shortcut" attribute in bundle server access_rules used to dynamically expand non-absolute request paths. - masterfiles - standard library split: lib/3.5 (compatibility) and lib/3.6 (mainline) - many standard library bundles and bodies, especially packages- and file-related, were revised and fixed - supports both Community and Enterprise - new 'inventory/' structure to provide OS, dmidecode, LSB, etc. system inventory (configured mainly in def.cf) - cf_promises_release_id contains the policy release ID which is the GIT HEAD SHA if available or hash of tree - a bunch'o'bundles to make starting with CFEngine easier: - file-related: file_mustache, file_mustache_jsonstring, file_tidy, dir_sync, file_copy, file_link, file_hardlink, file_empty, file_make - packages-related: package_absent, package_present, package_latest, package_specific_present, package_specific_absent, package_specific_latest, package_specific - XML-related: xml_insert_tree_nopath, xml_insert_tree, xml_set_value, xml_set_attribute - VCS-related: git_init, git_add, git_checkout, git_checkout_new_branch, git_clean, git_stash, git_stash_and_clean, git_commit, git - process-related: process_kill - other: cmerge, url_ping, logrotate, prunedir - New command line options for agent binaries - New options to cf-promises - '--show-classes' and '--show-vars' - '--eval-functions' controls whether cf-promises should evaluate functions - Colorized output for agent binaries with command line option '--color' (auto-enabled if you set CFENGINE_COLOR=1) - New language features - New variable type 'data' for handling of structured data (ie JSON), including supporting functions: - 'data_readstringarray' - read a delimited file into a data map - 'data_readstringarrayidx' - read a delimited file into a data array - 'datastate' - create a data variable with currently set classes and variables - 'datatype' - determine the type of the top element of a container - 'format' - %S can be used to serialize 'data' containers into a string - 'mergedata' - merge two data containers, slists/ilists/rlists, or "classic" arrays into a data container - 'parsejson' - create a data container from a JSON string - 'readjson' - create a data container from a file that contains JSON - 'storejson' - serialize a data container into a string - Most functions operating on lists can also operate on data containers - pass a data container to a bundle with the @(container) notation - the module protocol accepts JSON for data containers with the '%' sigil - Tagging of classes and variables allows annotating of language construct with meta data; supporting functionality: - The module protocol in 'commands' promises has been extended to allow setting of tags of created variables and classes, and the context of created variables - 'getclassmetatags' - returns list of meta tags for a class - 'getvariablemetatags' - returns list of meta tags for a variable - 'body file control' has an 'inputs' attribute to include library files and other dependencies - bundlesequences can be built with bundlesmatching() based on bundle name and tags - New attributes in existing promise types and bodies - New option 'preserve_all_lines' for insert_type in insert_lines promises - Caching of expensive system functions to avoid multiple executions of execresult() etc, can be controlled via cache_system_functions attribute in body common control - New option 'mailsubject' in body executor control allows defining the subject in emails sent by CFEngine - Support for Mustache templates in 'files' promises; use 'template_method' and 'template_data' attributes. Without 'template_data' specified, uses datastate(). - New and improved functions - 'bundlesmatching' - returns list of defined bundles matching a regex and tags - 'canonifyuniquely' - converts a string into a unique, legal class name - 'classesmatching' - returns list of set classes matching a regex and tags - 'eval' - evaluates mathematical expressions; knows SI k, m, g quantifiers, e.g. "100k" - 'findfiles' - list files matching a search pattern; use "**" for recursive searches - 'makerule' - evaluates whether a target file needs to be rebuilt from sources - 'max', 'min' - returns maximum and minimum of the numbers in a container or list (sorted by a 'sort' method) - 'mean' - returns the mean of the numbers in a container or list - 'nth' - learned to look up by key in a data container holding a map - 'packagesmatching' - returns a filtered list of installed packages. - 'readfile' - learned to read system files of unknown size like those in /proc - 'sort' - can sort lexicographically, numerically (int or real), by IP, or by MAC - 'string_downcase', 'string_upcase' - returns the lower-/upper-case version of a string - 'string_head', 'string_tail' - returns the beginning/end of a string - 'string_length' - returns the length of a string - 'string_reverse' - reverses a string - 'string_split' - improved implementation, deprecates 'splitstring' - 'variablesmatching' - returns a list of variables matching a regex and tags - 'variance' - returns the variance of numbers in a list or container - New hard classes - Introduced alias 'policy_server' for context 'am_policy_hub' (the latter will be deprecated) - all the time-based classes have GMT equivalents - New variables - 'sys.bindir' - the location of the CFEngine binaries - 'sys.failsafe_policy_path' - the location of the failsafe policy file - 'sys.inputdir' - the directory where CFEngine searches for policy files - 'sys.key_digest' - the digest of the host's cryptographic key - 'sys.libdir', 'sys.local_libdir' - the location of the CFEngine libraries - 'sys.logdir' - the directory where the CFEngine log files are saved - 'sys.masterdir' - the location of masterfiles on the policy server - 'sys.piddir' - the directory where the daemon pid files are saved - 'sys.sysday' - the number of days since the beginning of the UNIX epoch - 'sys.systime' - the number of seconds since the beginning of the UNIX epoch - 'sys.update_policy_path' - the name of the update policy file - 'sys.uptime' - the number of minutes the host has been online - 'this.promise_dirname' - the name of the file in which the current promise is defined - 'this.promiser_uid' - the ID of the user running cf-agent - 'this.promiser_gid' - the group ID of the user running cf-agent - 'this.promiser_ppid' - the ID of the parent process running cf-agent Deprecations: - 'splitstring' - deprecated by 'string_split' - 'track_value' - 'skipverify' Bug fixes: for a complete list of fixed bugs, see Redmine at https://cfengine.com/dev - Various fixes in evaluation and variable resolution - Improve performance of list iteration (Redmine #1875) - Removed limitation of input length to internal buffer sizes - directories ending with "/" are not ignored - lsdir() always return a list now, never a scalar - 'abortclasses' fixed to work in common bundles and other cases - Namespaced 'edit_line' bundles now work (Redmine#3781) - Lists are interpolated in correct order (Redmine#3122) - cf-serverd reloads policies properly when they change - Lots of leaks (memory and file descriptor) fixed 3.5.3 Changes: - Improved security checks of symlink ownership. A symlink created by a user pointing to resources owned by a different user will no longer be followed. - Changed the way package versions are compared in package promises. (Redmine #3314) In previous versions the comparison was inconsistent. This has been fixed, but may also lead to behavior changes in certain cases. In CFEngine 3.5.3, the comparison works as follows: For instance: apache-2.2.31 ">=" "2.2.0" will result in the package being installed. Bug fixes: - Fix cf-monitord crash due to incorrect array initialization (Redmine #3180) - Fix cf-serverd stat()'ing the file tree every second (Redmine #3479) - Correctly populate sys.hardware_addresses variable (Redmine #2936) - Add support for Debian's GNU/kfreebsd to build system (Redmine #3500) - Fix possible stack corruption in guest_environments promises (Redmine #3552) - Work-around hostname trunctation in HP-UX's uname (Redmine #3517) - Fix body copy purging of empty directories (Redmine #3429) - Make discovery and loading of avahi libraries more robust - Compile and packaging fixes for HP-UX, AIX and Solaris - Fix fatal error in lsdir() when directory doesn't exist (Redmine #3273) - Fix epoch calculation for stime inrange calculation (Redmine #2921) 3.5.2 Bug fixes: - Fix delayed abortclasses checking (Redmine #2316, #3114, #3003) - Fix maplist arguments bug (Redmine #3256) - Fix segfaults in cf-pomises (Redmine #3173, 3194) - Fix build on Solaris 10/SmartOS (Redmine #3097) - Sanitize characters from /etc/issue in sys.flavor for Debian (Redmine #2988) - Fix segfault when dealing with files or data > 4K (Redmine #2912, 2698) - Don't truncate keys to 126 characters in getindices (Redmine #2626) - Files created via log_* actions now have mode 600 (Redmine #1578) - Fix wrong log message when a promise is ignored due to 'ifvarclass' not matching - Fix lifetime of persistent classes (Redmine #3259) - Fix segfault when process_select body had no process_result attribute Default to AND'ed expression of all specified attributes (Redmine #3224) - Include system message in output when acl promises fail - Fix invocation of standard_services bundle and corresponding promise compliance (Redmine #2869) 3.5.1 Changes: - File changes are logged with log level Notice, not Error - The CFEngine Standard Library in masterfiles/libraries is now split into promise-type specific policy files, and lives in a version-specific directory. This should have no impact on current code, but allows more granular include of needed stdlib elements (Redmine #3044) Bug fixes: - Fix recursive copying of files (Redmine #2965) - Respect classes in templates (Redmine ##2928) - Fix timestamps on Windows (Redmine #2933) - Fix non-root cf-agent flooding syslog (Redmine #2980) - Fix email flood from cf-execd due to timestamps in agent output (Redmine #3011) - Preserve security context when editing or copying local files (Redmine #2728) - Fix path for sys.crontab on redhat systems (Redmine #2553) - Prevent incorrect "insert_lines promise uses the same select_line_matching anchor" warning (Redmine #2778) - Fix regression of setting VIPADDRESS to 127.0.0.1 (Redmine #3010) - Fix "changes" promise not receiving status when file is missing (Redmine #2820) - Fix symlinks being destroyed when editing them (Redmine #2363) - Fix missing "promise kept" status for the last line in a file (Redmine #2943) 3.5.0 New features: - classes promises now take an optional scope constraint. - New built-in functions: every, none, some, nth, sublist, uniq, filter - every - none - some - nth - sublist - uniq - filter - classesmatching - strftime - filestat - ifelse - maparray - format - cf-promises flag --parse-tree is replaced by --policy-output-format=, requiring the user to specify the output format (none, cf, json) - cf-promises allows partial check of policy (without body common control) without integrity check; --full-check enforces integrity check - Agent binaries support JSON input format (.json file as generated by cf-promises) - cf-key: new options --trust-key/-t and --print-digest/-p - Class "failsafe_fallback" is defined in failsafe.cf when main policy contains errors and failsafe is run because of this - Add scope attribute for body classes (Redmine #2013) - Better diagnostics of parsing errors - Error messages from parser now show the context of error - New cf-agent option: --self-diagnostics - New output format, and --legacy-output - Warnings for cf-promises. - Enable zeroconf-discovery of policy hubs for automatic bootstrapping if Avahi is present - Support for sys.cpus on more platforms than Linux & HPUX Changes: - Parser no longer allows ',' after promiser or promisee. must be either ';' or lval - Make parser output in GCC compatible format the only supported format (remove --gcc-brief-format flag) - Silence license warnings in Enterprise Free25 installations - action_policy => "warn" causes not_kept classes to be set on promise needing repair. - Command line option version (-V) now prints a shorter parsable version without graphic - Implicit execution of server and common bundles taking arguments is skipped in cf-serverd. - WARNING: option --policy-server removed, require option to --bootstrap instead - process promises don't log if processes are out of range unless you run in verbose mode - reports promises are now allowed in any context (Redmine #2005) - cf-report has been removed - cf-execd: --once implies --no-fork - Version info removed from mail subject in the emails sent by cf-execd. The subject will only contain "[fqname/ipaddress]" instead of "communnity/nova [fqname/ipaddress]" Please change your email filters accordingly if necessary. - "outputs" promise type is retired. Their semantics was not clear, and the functionality is better suited for control body setting, not a promise. - Tokyo Cabinet databases are now automatically checked for correctness during opening. It should prevent a number of issues with corrupted TC databases causing binaries to hang. - Improved ACL handling on Windows, which led to some syntax changes. We now consistently use the term "default" to describe ACLs that can be inherited by child objects. These keywords have received new names: acl_directory_inherit -> acl_default specify_inherit_aces -> specify_default_aces The old keywords are deprecated, but still valid. In addition, a new keyword "acl_inherit" controls inheritance behavior on Windows. This feature does not exist on Unix platforms. (Redmine #1832) - Networking code is moved from libpromises to its own library, libcfnet. Work has begun on making the API more sane and thread-safe. Lots of legacy code was removed. - Add getaddrinfo() replacement in libcompat (borrowed from PostgreSQL). - Replace old deprecated and non thread-safe resolver calls with getaddrinfo() and getnameinfo(). - Hostname2IPString(), IPString2Hostname() are now thread-safe, and are returning error when resolution fails. - Running cf-execd --once now implies --no-fork, and also does not wait for splaytime to pass. - execresult(), returnszero() and commands promises no longer requires the first word word to be an absolute path when using the shell. (Part of Redmine #2143) - commands promises useshell attribute now accepts "noshell" and "useshell" values. Boolean values are accepted but deprecated. (Part of Redmine #2143) - returnszero() now correctly sets the class name in this scenario (Part of Redmine #2143): classes: "commandfailed" not => returnszero("/bin/nosuchcommand", "noshell"); Bugfixes: - Bundles are allowed to be empty (Redmine #2411) - Fixed '.' and '-' not being accepted by a commands module. (Redmine #2384) - Correct parsing of list variables by a command module. (Redmine #2239) - Fixed issue with package management and warn. (Redmine #1831) - Fixed JSON crash. (Redmine #2151) - Improved error checking when using fgets(). (Redmine #2451) - Fixed error message when deleting nonexistent files. (Redmine #2448) - Honor warn-only when purging from local directory. (Redmine #2162) - Make sure "restart" and "reload" are recognized keywords in packages. (Redmine #2468) - Allocate memory dynamically to avoid out-of-buffer or out-of-hash situations - Fix edit_xml update of existing attributes (Redmine #2034) - Use failsafe policy from compile-time specified workdir (Redmine #1991) - ifvarclass checked from classes promises in common bundles - Do not wait for splaytime when executing only once - Disable xml editing functionality when libxml2 doesn't provide necessary APIs (Redmine #1937) - Out-of-tree builds should work again, fixed a bunch of related bugs. - Fixed race condition in file editing. (Redmine #2545) - Fixed memory leak in cf-serverd and others (Redmine #1758) 3.4.5: (Bugfix and stability release) Bugfixes: - Make qualified arrays expand correcty (Redmine #1998, Mantis #1128) - Correct possible errors in tcdb files when opening - Avoid possible db corruption when mixing read/write and cursor operations - Allow umask value of 002 (Redmine #2496) 3.4.4: (Bugfix and stability release) Bugfixes: - Prevent possible crash when archiving files (GitHub #316) - Don't create symlinks to cf-know in update policy - Don't enable xml support if libxml2 is too old (Redmine #1937) 3.4.3: (Bugfix and stability release) Bugfixes: - Don't flood error messages when processes are out of defined range - Prevent segmentation fault in cf-monitord -x (Redmine #2021) - When copying files, use same file mode as source file, rather than 0600 (Redmine #1804) - Include xpath in messages generated by edit_xml operations (Redmine #2057) 3.4.2: (Bugfix and stability release) Bugfixes: - Fixes to policies in masterfiles (see masterfiles/Changelog for details) - Fixes for OpenBSD (GitHub #278) - Do not canonify values specified in abortbundleclasses/abortclasses (Redmine #1786) - Fix build issues on NetBSD, SLES 12.2 - Improve error message when libxml2 support is not compiled (Redmine #1799) - Fix potential segmentation fault when trimming network socket data (GitHub #233) - Fix potential segmentation fault when address-lookups in lastseen db failed (GitHub #233) - Execute background promise serially when max_children was reached, rather than skipping them (GitHub #233) - Fix segmentation fault in cf-promises when invoked with --reports (Redmine #1931) - Fix compilation with Sun Studio 12 (Redmine #1901) - Silence type-pun warning when building on HP-UX (GitHub #287) 3.4.1: (Bugfix and stability release) New feature/behavior: - cf-execd terminates agent processes that are not responsive for a configurable amount of time (see agent_expireafter in body executor control), defaulting to 1 week Bugfixes: - Fix regression of classmatch() failing with hard classes (Redmine #1834) - Create promise-defined and persistent classes in correct namespace (Redmine #1836) - Several fixes to namespace support - Fix several crash bugs caused by buffer overflow and race conditions in cf-serverd - Regenerate time classes in cf-execd for each run (Redmine #1838) - edit_xml: fix select_xpath implementation and update documentation NOTE: code that uses select_xpath_region needs to be changed to select_xpath - edit_xml: make sure that text-modification functions don't overwrite child nodes - edit_xml: improve error logging 3.4.0 New features: - Added rpmvercmp utility to compare versions of RPM packages for accurate sorting of RPM packages for packages promises. - Implement network timeout on server side to avoid keeping stale connections for hours. - XML editing capabilities. See the documentation for edit_xml body. Note the new dependency: libxml2. - Implement inheritance of local classes by bundles called using "usebundle". By default classes are not inherited. See the examples/unit_inherit.cf for an example. - Moved from Nova/Enterprise: - POSIX ACL support, - "outputs" promise type, - remote syslog support. - packages_default_arch_command hook in packages promises, to specify default architecture of the packages on the system. - packages_version_less_command / packages_version_equal_command hooks in packages promises, to specify external command for native package manager versions comparison - agent_expireafter in body executor control allows you to set a timeout on all cf-agent runs, to enforce a threshold on the number of concurrent agents - Running in Solaris zone is now detected and classes "zone" and "zone_ " are created in this case. - VirtualBox support added to guest_environment promises. - guest_environment promises are supported under OS X. - The "depends_on" attribute is now active, for the partal ordering of promises. If a promise depends on another (referred by handle) it will only be considered if the depends_on list is either kept or repaired already. ** WARNING: When upgrading, make sure that any existing use of depends_on does not make some promises being unintentionally ignored. This can happen if you are currently referring to non-existent or never-run handles in depends_on attributes. - methods return values, initial implementation - New format for cf-key -s, includes timestamp of last connection - cf-promises --parse-tree option to parse policy file and dump it in JSON format - Namespaces support for bundles and bodies. See the examples/unit_namespace*.cf for the usage. - Default arguments for bundles. See the examples/unit_defaults.cf - Metadata promise type. See the examples/unit_meta.cf New semantics: - Methods promises now return the status of promises kept within them. If any promise was not kept, the method is not kept, else if any promise is repaired, the method was repaired else it was kept. - Remote variable access in namespaces by $(namespace:bundle.variable) Changed functionality: - cf-execd -F switch no longer implies 'run once'. New -O/--once option is added to achieve this behaviour. This makes cf-execd easier to run from systemd, launchd and other supervision systems. Misc: - Support for the following outdated platforms and corresponding classes has been removed. De facto those platforms were unsupported for a long time, as CFEngine codebase uses C99 language features unavailable on old platforms: - SunOS 3.x (sun3) - SunOS 4.x (sun4) - Ultrix (ultrix) - DEC OSF/1 AXP (osf) - Digital UNIX (digital) - Sony NEWS (newsos) - 4.3BSD (bsd4_3) - IRIX (irix, irix4, irix64) - IBM Academic Operating System (aos) - BSD/OS / BSDi / BSD/386 (bsdos) - NeXTSTEP (nextstep) - GNU Hurd (gnu) - NEC UX/4800 (ux4800) - (Old news) Since 3.3.0 the layout of CFEngine Community packages has changed slightly. cf-* binaries have been moved to /var/cfengine/bin, due to the following reasons: - cf-* binaries are linked to libraries installed to /var/cfengine/lib, so placing binaries in /usr/local/sbin does not increase reliability of the CFEngine, - keeping whole CFEngine under single prefix (/var/cfengine) makes packaging simpler, - it matches the layout of CFEngine Enterprise packages. Please adjust your policies (the recommended ways to deal with the move are either to adjust $PATH to include /var/cfengine or to create symlinks in /usr/local/sbin in case you are relying on binaries to be available in $PATH). - Workdir location is properly changed if --prefix or --enable-fhs options are supplied to configure (Mantis #1195). - Added check for broken libmysqlclient implementations (Mantis #1217). - Standard library is updated from COPBL repository. - cf-know is no longer built in Community releases. The only functionality useful in Community, namely the reference manual generation, is provided by new compile-time cf-gendoc tool. - Filename (for storing filechanges) changed from file_change.log -> file_changes.log (in /var/cfengine/state) New format for storing file changes introduced: [timestamp,filename, ,Message] N = New file found C = Content Changed S = Stats changed R = File removed - Acceptance test suite passes on Mac OS X. - Changed some port numbers to replace old services with imap(s) - archlinux hard class on Arch Linux. - Detect BSD Make and automatically switch to GNU Make during build. Bugfixes: - cfruncommand for cf-execd is an arbitrary shell command now (Mantis #1268). - Fixed broken "daily" splayclasses (Mantis #1307). - Allow filenames up to 4096 bytes in network transfers (Redmine #1199). - Fix stale state preserved during cf-serverd reload (Redmine #1487). - Free disk space calculation is fixed (Mantis #1120). - Numerous portability bugfixes (especially OpenBSD, Solaris, AIX-related). - Compatibility fixes for AIX, HP-UX, Solaris (Mantis #1185, Mantis #1177, Mantis #1109). - Fixed broken socklen_t configure check under OpenBSD (Mantis #1168). - Fixed hang in cf-promises under OpenBSD (Mantis #1113). - Fixed endless loop in evaluating "$()" construct (Mantis #1023). - Fixed check for old PCRE versions (Mantis #1262). - Fixed insertion of multi-line blocks at the start of file (Mantis #809). - Fixed numerous memory leaks. - Fixes for metadata that were not resolvable - Fixes for namespaces that would not support metadata and variable expansion - Point-to-point network interfaces are detected and reported by CFEngine (Mantis #1246) - Partial non-GNU userspace support in acceptance testsuite (Mantis #1255) Full list of issues fixed is available on https://cfengine.com/bugtracker/changelog_page.php (old bug tracker) and https://cfengine.com/dev/projects/core/versions/34 (new bug tracker) 3.3.9: (Bugfix and stability release) Bugfixes: - Do not lose hard classes in cf-serverd during policy reload (Mantis #1218). - Implement receive network timeout in cf-serverd. Prevents overloading cf-serverd with stale connections. 3.3.8: (Bugfix and stability release) Versions 3.3.6, 3.3.7 were internal and weren't released. Bugfixes: - Propery set sys.domain variable if hostname is fully-qualified. - Fixed several small memory leaks. - Make network timeout for network reads configurable. Previously it was hardcoded to be 30 seconds, which was not enough for cf-runagent invoking cf-agent on big policies (Mantis #1028). 3.3.5: (Bugfix and stability release) Bugfixes: - Fixed cf-execd memory leak on hosts with cf-monitord running. - Robustify against wrongly-sized entires in embedded databases. Standard library: - Bugfixes from upstream COPBL repository. - standard_services bundle from upstream COPBL repository. 3.3.4: (Bugfix and stability release) Evaluation of policies: - Fix wrong classes set after installation of several packages using packages promises (Mantis #829). - Fix segfault using edit_template on existing file (Mantis #1155). Misc: - Fix memory leak during re-read of network interfaces' information in cf-execd/cf-serverd. 3.3.3: (Bugfix and stability release) Evaluation of policies: - Zero-length files are valid for readfile() and similar functions (Mantis #1136). - Unchoke agent in case it encounters symlinks in form ./foo (Similar to Mantis #1117). Misc: - Fix generation of reference manual on machines with umask more relaxed than 022. - Use statvfs(3) on OpenBSD to obtain filesystem information (Mantis #1135). 3.3.2: (Bugfix and stability release) Evaluation of policies: - Do not segfault if file copy was interrupted due to network connectivity or server going away (Mantis #1089). - Do not segfault if log_failed attribute is present in body, but log_kept is not (Mantis #1107). - Do not mangle relative paths in symlinks during file copy Previously symlink a -> b was mangled to a -> ./b. (Mantis #1117) - Properly compare 1.0 and 1.0.1 in packages promises. Previously only versions with equal amount of "segments" were comparable (Mantis #890, #1066). Base policy: - Properly set permissions on files for /var/cfengine/lib on HP-UX (Mantis #1114). - Standard library (cfengine_stdlib.cf) is synced with COPBL repository. Misc: - Do not create huge file in case corrupted TokyoCabinet database is detected (Mantis #1106). - Fix file descriptor leak on error paths, may have caused crashes of cf-execd and cf-serverd (Issue #1096). - Fix intermittent segfault in cf-execd (Mantis #1116). - Impose an upper limit on amount of listening sockets reported by cf-monitord. Huge amounts of listening sockets caused cf-agent to segfault on next run (Mantis #1098). - Add missing function prototypes caused errors during compilation on HP-UX (Mantis #1109). - Fix compilation on Solaris 11 (Mantis #1091). 3.3.1: (Bugfix and stability release) Evaluation of policies: - Do not cut off name of bundle in variables interpolation (Mantis #975). - Do not segfault in function evaluation guarded by ifvaclass clause (Mantis #1084, #864). - Do not segfault if "classes" promise does not declare any value to be evaluated (Mantis #1074). - Do not segfault in database promises if there is no database_operation provided (Mantis #1046). Built-in functions: - Fix countclassesmatching() function which was misbehaving trying to match classes starting with alphanumeric symbol (Mantis #1073). - Fix diskfree() to return kilobytes, as described in documentation (Mantis #980, #955). - Fix hostsseen() function to avoid treating all hosts as not being seen since 1970 (Mantis #886). - Do not output misleading error message if readtcp() is unable to connect (Mantis #1085). Command-line interface: - -d option previously reqired an argument, though help message disagreed (Mantis #1053). - Disable --parse-tree option, not ready for the release (Mantis #1063). - Acept -h as a --help option. - Ensure that cf-execd might be started right after being shut down. Misc: - Plug file descriptor leak after failed file copy (Mantis #990). - Fix unsafe admit rules in default promises.cf (Mantis #1040). - Fix splaytime to match documentation: it is specified in minutes, not seconds (Mantis #1099). Packaging: - Fix owner/group of initscript and profile.d snippet in RPM builds (Mantis #1061, #1058). - Fix location of libvirt socket CFEngine uses to connect to libvirtd (Mantis #1072). - Install CoreBase to /var/cfengine/masterfiles during installation (Mantis #1075). - Do not leave old cf-twin around after upgrade (Mantis #1068) - Do not leave rcS.d symlinks after purging .deb package (Mantis #1092). 3.3.0 New promise types: - Guest environments promises, which allow to manipulate virtual machines using libvirt. - Database promises, which allow to maintain schema of MySQL and PostgreSQL databases. Database promises are in "technical preview" status: this promise type is subject to change in future. - Services promises for Unix, allows abstraction of details on managing any service New built-in functions: - dirname() to complement lastnode() - lsdir() - maplist() to apply functions over lists New features: - Allow defining arrays from modules. - Allow both process_stop' and signals' constraints in processes' promises at the same time. - cf-promises --gcc-brief-format option to output warnings and errors in gcc-compatible syntax which to ease use "go to next error" feature of text editors. - Iteration over lists is now allowed for qualified (non-local) lists. New built-in variables and classes (Linux): - Number of CPUs: $(sys.cpus), 1_cpu, 2_cpus etc New built-in variables and classes (Unices): - $(sys.last_policy_update) - timestamp when last policy change was seen by host - $(sys.hardware_addresses) - list of MAC adresses - $(sys.ip_addresses) - list of IP addresses - $(sys.interfaces) - list of network interfaces - $(sys.hardware_mac[$iface]) - MAC address for network interface - mac_ :: - discovered MAC addresses Changes: - Major cleanup of database handling code. Should radically decrease amount of database issues experienced under heavy load. *WARNING*: Berkeley DB and SQLite backends are *removed*, use Tokyo Cabinet or QDBM instead. Both Tokyo Cabinet and QDBM are faster than Berkeley DB in typical CFEngine workloads. Tokyo Cabinet requires C99 environment, so it should be available on every contemporary operating system. For the older systems QDBM, which relies only on C89, is a better replacement, and deemed to be as portable, as Berkeley DB. - Change of lastseen database schema. Should radically decrease I/O contention on lasteen database. - Automatic reload of policies by cf-execd. - Documentation is generated during build, PDF and HTML files are retired from repository. - Rarely used feature retired: peer connectivity intermittency calculation. - Memory and CPU usage improvements. - Testsuite now uses 'make check' convention and does not need root privileges anymore. - cf_promises_validated now filled with timestamp, allows digest-copy for policy instead of mtime copy which is safer when clocks are unsynchronised - The bundled failsafe.cf policy now has trustkey=false to avoid IP spoofing attacks in default policy - See the full list of bugfixes at https://cfengine.com/bugtracker/changelog_page.php 3.2.4: (Bugfix and stability release) - Fixed failure in network transfer in case of misbehaving peer - A few tiny memory leaks on error paths fixed 3.2.3: (Bugfix and stability release) - A few tiny memory leaks fixed - Improved performance of cf-serverd under heavy load with TokyoCabinet database - Full list of issues fixed is available on https://cfengine.com/bugtracker/changelog_page.php 3.2.2: (Bugfix and stability release) - Enabled compilation in "large files" mode under AIX - Alleviated problem with broken file transfers over unstable internet links. - Full list of issues fixed is available on https://cfengine.com/bugtracker/changelog_page.php 3.2.1: (Bugfix and stability release) - Fixed compilation under HP-UX and Solaris - Enabled compilation using HP ANSI C compiler - Full list of issues fixed is available on - https://cfengine.com/bugtracker/changelog_page.php 3.2.0: New bootstrap method with single-command bootstrapping: - cf-agent --bootstrap --policy-server 123.456.789.123 - Associated policy template files are added, partially maintained by CFEngine - Bug fixes for file-editing, package versioning, and embedded database corruption (We recommend using TokyoCabinet instead of BerkeleyDB if building from source). - Improved upgrade path for Nova. - Patches for improved run-agent concurrency - Reorganization of documentation and community resources - 100% on regression test suite on 3 operating systems (Ubuntu, Debian, SuSE on x86-64 hardware) - Support for multiple release environments - package_policy update and addupdate now check if user-supplied version is larger than currently installed - updates only if so - Help text of cf-report -r corrected - a list of key hashes is required, not ip addresses. - New Emacs mode for CFEngine policy files (thanks to Ted Zlatanov!) - Warnings are on edit_line changes can now give greater degree of information without spamming promise logs - Class expressions parser accepts '||' as an alias for '|' again. - Invalidation of package list cache on installation/removal of packages. - New option cf-key -r to remove host key by IP or hostname. - Added detection of network interfaces which belong to BSD jails. - Improve robustness of multi-threaded code, in particular fix problems with spurious access denials in server and losing of authentication rules after policy reload. - cf-promises accepts option -b matching cf-agent, which causes it to do not complain about missing bundlesequence. - New functions and(), not(), or() and concat() to ease use of ifvarclass() clause. - Full list of issues fixed is available on https://cfengine.com/bugtracker/changelog_page.php 3.1.5: - New class parser, '||' is no longer allowed in expressions (use '|'). - Class setting in the promise types insert_lines, delete_lines, replace_patterns, field_edits, vars, classes is restored. - suspiciousnames implemented. - New function getvalues(). - New functions parse{read,int,string}array to match read{read,int,string}array. - Testsuite added to check for core functionality. - Syslog prefix is fixed to say 'cf3' instead of 'community'. 3.1.4: (Bugfix and stability release) - Some urgent patches to 3.1.3. - Class validation parse bug fixed. - Global zone handling error for solaris fixed. - Package architectures handled correctly (bug #456). - Reading and writing of key name "root-.pub" eliminated (bug #442, #453). - cf-serverd crash because of race condition on SERVER_KEYSEEN fixed. - Lock purging to avoid remnant complexity explosion (bug #430). - Some copyright notices added that got lost. 3.1.3: (Stability release) - Major memory leaks in cf-monitord, cf-execd, cf-serverd fixed (bug #427). The daemons now show no growth even with very complex policies. - cf-serverd crash due to race condition in DeleteScope() fixed (bug #406). - Added 30 second timeout on recv() on Linux. - package_noverify_returncode implemented (bug #256). - A flexible mechanism for setting classes based on return codes of commands has been introduced. Allows for setting promise kept, repaired or failed based on any return codes. This is currently implemented for commands-promises, package-manager commands and transformer in files. In classes body, see attributes kept_returncodes, repaired_returncodes, failed_returncodes (bug #248, #329). - New function ip2host - reverse DNS lookup (bug #146). 3.1.2: (Scalability/efficiency release) - Big efficiency improvements by caching output from cf-promises. Can also be used for much more efficient policy deployment (only pull if changed). - Caching state of ps command for greater efficiency. Reloaded for each bundle. - Index class lookup improves efficiency of class evaluation for huge configurations. - Fixed issue where certain promiser strings got corrupted. - Minor memory access issues fixed. - Iterator bug introduced in 3.1.0 fixed 3.1.1: (Bugfix release) - Memory leaks in server tracked down and fixed. - List expansion bug (one list items not executed) fixed. - Security issue introduced by change of runcommand shell policy fixed. If users defined a runcommand for cf-runagent/cf-serverd communication, possible to execute commands. - cf-key -s command for showing key hash/IP address identity pairs 3.1.0: - Change in storage of public keys. Cfengine now hashes the public key and uses this as the keyname. Keys will be converted automatically. - The old dynamic addresses lists are deprecated. Caching of dns and key information for greater server speed. Change in last-seen format reflects the public key usage. - New package policy addupdate - installs package if not there and updates it otherwise. - Support for package_changes => "bulk" in file repository as well. - New special function readstringarrayidx, similar to readstringarray, but uses integer indices. Very useful if first row elements are not good identifiers (e.g. contains spaces, non-unique, etc.). - Change two log formats to use time() instead of date() - filechanges - total compliance - Change from using md5 to sha256 as default digest for commercial version, community retains md5 for compat. - Commands not returning 0 in commands-promises are flagged as repair_failed. - Adjustable timeout on connect(). Defaults to 10 seconds, adjustable with default_timeout in agent control. - Redesign of the knowledge map infrastructure. - Now possible to use variables to call methods, e.g methods: "name $(list)" usebundle => $(list)("abc"); See reference manual notes - Changes to normal ordering to optimize execution. - Increased stability by always initializing Attribute and Promise structures. - When running cf-promises in dry-run mode (-n), the user does not need to put binaries in WORKDIR/bin. For example, non-privileged users can verify root policies. - Source control revision added in version string if run in verbose mode (e.g. "cf-promises -vV"). This needs some refining, uses revision of a header now. - New semantics in return values of list functions. Null values are now allowed and there is no iteration over empty lists. The value "cf_null" is reserved for use as a null iterator. 3.0.5p1: - Showing paths allowed/denied access to when cf-serverd is run in verbose mode. - Bug in server fixed for dynamic addresses. - File handle closure bugfix - too many open databases. - Seg fault in mount files fix. - Twin used in cf-execd without checking. - Check_root set wrong directory permissions at source not destination. - Error message degraded in body definition. - Undefined body not warned as error. - Various build enahncements. - Package_list_update called only once per manager, and fixed crash. - Version number bug in packages. 3.0.5: - Encryption problems fixed - client key buffer was uninitialized. - Classes-promisers are now automatically canonified when class strings are defined, to simplifying the use of variables in classes. - New scalars sys.cf_version and sys.nova_version that hold Cfengine version information. - Attribute package_delete_convention added, to allow customizable package name in delete command during update. - package_list_update_ifelapsed limit added. - Private variable $(firstrepo) is available in package_name_convention and package_delete_convention in order to expand the full path to a package, which is required by some managers. - Some of the threading code is rewritten and made more robust. This includes synchronizing access to the lastseen database from the server. - Bad initialization of BSD flags fixed - Multiple variable expansion issues in control fixed for server and agent - Allow ignore_missing_bundles to affect methods: bundles too - Run agent trust dialogue fixed - Bug in CPU monitoring, increasing time scale caused linear decay of CPU measurement. - Bug in Setuid log storage, fix. - Hooks added for new Nova virtualization promises. - Multithreading mutex failed to collide during cfservd leading to dropped authentication under heavy load. 3.0.4: - Class cancellation in promises to create better class feedback, allows emulation of switch/case semantics etc - Value of SA measurement promises - Special function getenv() which returns the contents of an environment variable (on all platforms). - New function translatepath for generic Windows - New function escape() to escape literals as regular expressions (like SQL) - New function host2ip for caching IP address lookup - New function regextract for setting variables with backreferences - New variables for the components $(sys.cf_agent), $(sys.cf_know) etc pointing to the binaries. - More robust integrated database implementation; closing all handles when receiving signals, self-healing on corruption. - Package installation on localhost without a manager like yum completed, multiple repositories searched, and universal methods. - Numerous bugfixes 3.0.3: - sha256 .. new hashes in openssl included in syntax tree. - End of line autocropping in readfile (hopefully intelligent) - hashmatch function incorrectly implemented - old debugging code left behind. Fix. - sys.crontab variable - Unknown user is now interpretated as "same user", so that we give CFEngine a chance to fix - Unregistered addresses no longer report "(Non registered IP)", but return as the address itself when doing reverse lookups. 3.0.2: - IMPORTANT: Change in normal ordering of editing. replace comes after insert lines Much testing and minor bug fixing - Memory leaks fixed - Many hooks added for Nova enterprise extensions. - promise_output reports now placed in WORKDIR/reports directory - Initialization correction and self-correx in monitord - Many new body constraints added. - Code readied for enterprise version Nova. - -b option can override the bundlesequence (must not contain parameters yet) - collapse_destination_dir option added to copy so that files can be aggregated from subdirectories into a single destination. 3.0.1: - First standalone release, independent of CFEngine 2 Purge old definitions and check consistency. - NB: changed search_mode to be a list of matching values - Reporting rationalized in cf-promises with -r only to avoid leaving output files everywhere. - Hooks added for upcoming commercial additions to CFEngine. - Added classify() and hostinnetgroup() functions - Added additional change management options for change detection - Package management added - generic mechanisms. - Limits on backgrounding added to avoid resource contention during CFEngine runs. - Image type added to cf-know. - New classes for quartly shifts: Morning,Afternoon,Evening,Night - Bug fixes in editfiles - line insertion for multiple line objects - Change the name of the variables and context from the monitord for better separation of data, and shorter names. sys -> mon average -> av, stddev -> dev - Canonical name for windows changed from "nt" to "windows", also version names added "vista","xp" etc.. - License notices updated for dual license editions. 3.0.0: - First release of CFEngine 3. Known omissions: - no support for ACLs - no support for packages - no support for interface configuration - These will be added in the next release.
Masterfiles changelog
See also: Core changelog, Enterprise changelog
3.23.0: - Added ability to disable plain http for CFEngine Enterprise Mission Portal (ENT-10411) - Added ability to enable backup archives during policy update (ENT-10481) - Added ability to extend without overriding filename patterns to copy during policy update (ENT-10480) - Added bundle to facilitate migration of ignore_interfaces.rx from inputdir to workdir (ENT-9402) - Added self upgrade support for Amazon Linux 2 (ENT-10820) - Added ss to paths for linux (ENT-10413) - Aligned systemd service templates with core WantedBy=cfengine3.service was removed from systemd service templates for individual components. It was un-necessary as cfengine3.service already wants the individual services. https://github.com/cfengine/core/pull/5362 Ticket: (CFE-3982) - Avoided deleting python symlink when sys.bindir is not /var/cfengine/bin (CFE-4146) - Changed default self upgrade target version to be that of Hubs binary version (ENT-10664) - Fixed OS inventory for Amazon Linux 2 (ENT-10817) - Fixed apache listening on port 80 by default (ENT-10672) - Fixed cfe_autorun_inventory_aws_ec2_metadata_cache file creation Ticket: (CFE-4221) - Removed jq dependency and fixed lib/testing.cf tap output (CFE-4245, CFE-4246, CFE-4223) - Fixed self-upgrade for Debian and Ubuntu aarch64 clients (ENT-10816) - Guard against /sys/hypervisor/uuid not being readable (ENT-9931) - Made Mission Portal Apache SSLProtocol configurable via augments (ENT-10412) - Made allowconnects and allowallconnects configurable via Augments (ENT-10212) - Made lastseenexpireafter in body common control configurable via Augments (ENT-10414) - Removed considerations for old versions from bundle agent cfe_autorun_inventory_aws_ec2_metadata_cache (CFE-4222) - Stopped filtering $(sys.bindir) from dynamically determined python path (CFE-4223) - Fixed recommendation policy execution (ENT-10915) - Fixed postgresql.conf recommendations (ENT-10916) - Added rendering of custom mustache templates to $(sys.workdir)/modules (ENT-10793) - Fixed support for automatically installing semanage on el9 for federated reporting (ENT-10918) - Improved failure logging during federated reporting schema import (ENT-10789) - Added default:cfengine_mp_fr_debug_import class for federated reporting import debugging (ENT-10896) - Made $(sys.policy_hub) always be included in default:def.acl, allowconnects, and allowallconnects unless explicitly disabled (ENT-10951) 3.22.0: - Added inventory for policy version (ENT-9806) - Added condition to runalerts service to require stamp directory (ENT-9711) - Added guards against using regline() in cases where a file may not exist (ENT-9933) - Added self upgrade support for Ubuntu 22.04, Debian 11, and EL9 (ENT-10290) - Added ssl_request_log to list of hub log files (ENT-10192) - Added support for Rocky Linux in self upgrade policy (ENT-10335) - Adjusted dump.sh for multiple runs in between superhub imports (ENT-10274) - Aligned module build result with release artifact (ENT-10345) - Fixed body perms system_owned to account for Windows (ENT-9778) - Fixed SUSE package_inventory defaults (ENT-10248) - Improved federated reporting dump concurrency with database (ENT-10214) - Made TLS settings for components other than cf-serverd configurable via augments (ENT-10198) - Made agentfacility in body agent control configurable via Augments (ENT-10209) - Made allowciphers in body server control configurable via Augments (ENT-10182) - Made allowtlsversion in body server control configurable via Augments (ENT-10182) - Made body maxmaillines in body executor control configurable via Augments (ENT-9614) - Made mailsubject, mailfilter_include, and mailfilter_exclude configurable via Augments (ENT-10210) - Made package cache refresh for common_knowledge.list_update_ifelapsed configurable This change makes the number of minutes to wait between package cache updates for some package_method bodies configurable via augments. The package_method bodies affected by this include: - body package_method pip(flags) - body package_method npm(dir) - body package_method npm_g - body package_method brew(user) - body package_method apt - body package_method apt_get - body package_method apt_get_permissive - body package_method apt_get_release(release) - body package_method dpkg_version(repo) - body package_method rpm_version(repo) - body package_method yum - body package_method yum_rpm - body package_method yum_rpm_permissive - body package_method yum_rpm_enable_repo(repoid) - body package_method yum_group - body package_method rpm_filebased(path) - body package_method ips - body package_method smartos - body package_method opencsw - body package_method emerge - body package_method pacman - body package_method zypper - body package_method generic Additionally note that the package related bundles use the package_method bodies mentioned above and are similarly influenced. - bundle agent package_present(package) - bundle agent package_latest(package) - bundle agent package_specific_present(packageorfile, package_version, package_arch) - bundle agent package_specific_absent(packageorfile, package_version, package_arch) - bundle agent package_specific_latest(packageorfile, package_version, package_arch), - bundle agent package_specific(package_name, desired, package_version, package_arch) (CFE-4178) - Prevented management of runagent socket users when no users are listed (ENT-9535) - Removed specific old CFEngine version package module handling for windows (ENT-9948) - Started inventorying currently mounted file system types and mount points (ENT-8338) 3.21.0: - Added inventory for Raspberry Pi and DeviceTree devices (ENT-8628) - Added policy to enforce proper permissions on Mission Portal ldap directory (ENT-9693) - Added check to make sure cf-execd is running after attempting self upgrade on Windows - Added exception for ldap directory perms for settings.ldap.php (ENT-9697) (ENT-9573) - Added date to known paths for linux (CFE-4069) - Added fallback to top-level feeder dump directory (ENT-8936) - Added self upgrade knowledge for Suse 12, 15 and opensuse leap 15 (ENT-9209) - Added self upgrade knowledge for debian 11 (ENT-9210) - Added ssh in paths.cf so that policy writers can use $(paths.ssh) (CFE-4037) - Added support for multiple superhubs per feeder (ENT-8936) - Amazon Linux now uses --setopt-exit_on_lock=True in redhat_no_locking_knowledge (ENT-9057) - Avoided error stopping apache when no pid file exists (ENT-9108) - Disabled explicit setting for SSLCompression for Mission Portal Apache. OpenSSL3 does not provide compression capability, when enabled Apache will not start. (ENT-8933) - Fixed deleting multiple hosts with distributed cleanup utility (ENT-8979) - Fixed directory in which windows agents source packages for upgrade (ENT-9010) - Fixed services_autorun_inputs working independently from services_autorun (CFE-4017) - Fixed set_line_based() for case when edit_defaults.empty_before_use is true (ENT-5866) - Made proc inventory configurable via Augments (CFE-4056) - Make device-tree inventory quieter in containers (ENT-9063) - Stopped applying locks to masterfiles-stage (ENT-9625) - Stopped loading several Apache modules on Enterprise Hubs by default: mod_auth_basic, mod_authz_host, mod_authz_owner, mod_dbd, mod_authn_file, mod_authz_dbm (ENT-8607, ENT-8602, ENT-8706, ENT-8609, ENT-9072, ENT-8605) - Updated filename conventions for AIX and Solaris packages (ENT-9095) - Fixed detection of location for httpd.pid (ENT-9603) - Added policy to manage permissions for php/runalerts-stamp (ENT-9703) - Ensured manual edits to httpd.conf are reverted (ENT-9686) 3.20.0: - Renamed bundle agent main to bundle agent mpf_main (CFE-3947) - Added prelink to paths.cf - Added Enterprise Hub postgresql.conf to files monitored for diffs by default (ENT-8618) - Added PostgreSQL tunables for Federated Reporting (ENT-8617) - Added lib/templates to packaged assets (ENT-8533) - Added policy to patch apachectl for more robust stopping on Enterprise Hubs (ENT-8823) - Added policy update exclusion for directories named .no-distrib (ENT-8079) - Added support for 'option' option in pkg module (CFE-3568) - Added support for Amazon Linux in standalone self upgrade (ENT-8274) - Added support for downloading windows packages as part of self upgrade (ENT-8283) - Adjusted MPF to handle rxdirs default from true to false (CFE-951) - 755 perms on hub htdocs dir are now enforced (ENT-8212) - Proper owner and perms on docroot are now enforced(ENT-8280) - Prevented def.dir_masterfiles/.no-distrib from being copied (ENT-8079) - Cleaned up policy related to versions prior to 3.12 (CFE-3920) - Removed policy deprecated by sys.os_release (CFE-3933) - Updated bundle names and wording to reflect current tooling (CFE-3921) - Enabled setting environment attribute in body agent control via augments (CFE-3925) - Fixed inclusion of distributed cleanup python files during install (ENT-8393) - Fixed inventory for OS on Rocky Linux (ENT-8292) - Fixed promise status from package upgrade when architecture specified in promise (CFE-3568) - Made body classes u_kept_successful_command_results inherit_from u_results (CFE-3917) - Made CMDB update ignore locks (ENT-8847) - Updating host-specific CMDB data files now happens asynchronously (ENT-7357) - Fixed issue with apt_get package module on Ubuntu 22 (CFE-3976) - Fixed parsing of options attribute and added repo alias for repository option in pkg module (CFE-3568) - Fixed pkg module parsing input when values include equals (=) (CFE-3568) - Warn about missing dependencies for Distributed Cleanup utility (ENT-8832) - Fixed AIX watchdog default threshold for number of cf-execd processes (CFE-3915) - Stopped lowercasing software inventory on Windows (ENT-8424) - Fixed windows unattended self upgrade on Windows 2008 (ENT-8066) - Invalid feeder dump files are now skipped during import (ENT-8229) - Fixed FR clean bundle when off state (ENT-7969) - Fixed psql not found while FR import (ENT-8353) - Now clean_when_off FR bundle is only run when needed (ENT-8294) 3.19.0: - Added interpreter attribute to standalone self upgrade package_module bodies (CFE-3703, ENT-5752) - Added almalinux as a know derivative of rhel (ENT-7644) - Added class to prevent hub from seeding binary packages for use in self upgrade (ENT-7544) - Added cleanup of database and status semaphore when federation target_state is off (ENT-7233) - Added custom promise python library - Added distributed_cleanup utility for Federated Reporting (ENT-7215) - Added fallback logic for determining installed software version on Windows (ENT-7501) - Added lsmod to well known paths (CFE-3790) - Added script to cleanup artifacts after cfbs build (CFE-3781) - Added self upgrade support for SUSE (ENT-7446) - Added separate classes for controlling autorun inputs and bundles The class services_autorun continues to enable both automatic inclusion of .cf files in services/autorun and the running of bundles tagged with autorun. This change adds the classes services_autorun_inputs and services_autorun_bundles for independently enabling addition of .cf files in services/autorun and automatic execution of bundles tagged with autorun respectively. (CFE-3715) - Added support for downloading community packages on hub in preparation for binary upgrades - Added variable for excluding files from Policy Analyzer (ENT-7684) - Adjusted badges for 3.18.0 release (ENT-6713) - Adjusted permissions for Mission Portal public tmp files (ENT-7261) - Autorun bundles now run regardless of locks Previously, when the autorun feature was enabled to automatically run bundles tagged with autorun the bundle actuation was affected by promise locking. The effect of this is that agent runs that happen close together would skip running bundles run within the last minute. Now autorun bundles no longer wait for a lock to expire, they will be actuated each agent execution. Note, promises within those bundles have their own locks which still apply. (CFE-3795) - Dropped un-necessary local variable The use of this local variable triggers a bug that prevents datastate() from printing. Since the variable is un-necessary, it's been removed and the parameter is used directly. (CFE-3776) - Enforced permissions for Postgres log (ENT-7961) - Fixed package module augments settings usage for pre 3.15.3 binaries (ENT-7356, ENT-7358) - Fixed path in permissions and ownership promise for application log dir (ENT-7731) - Fixed services_autorun_bundles only case (CFE-3799) - Fixup zypper package module script to work properly with interpreter attribute (ENT-7442) - Gave cfapache group full access to docroot (ENT-8065) - Insured exported reports from Mission Portal are in the correct location (ENT-7465) - Made apache restart more robust (ENT-8045) - Moved httpd.pid to root of httpd workdir (ENT-7966) - Physical Memory (MB) inventory now handles dmidecode MB or GB units (ENT-7714) - Promised permissions for Mission Portal application and Apache log files This change ensures that both Mission Portal and Apache log files have restrictive permissions. Previously this was un-managed. (ENT-7730) - Reduced scope of report informing of missing systemd service (CFE-290, ENT-7360) - Removed build dir from install/dist targets (ENT-7359) - Removed stale CMDB inventory policy (CFE-3712) - Set apache umask to 0177 (ENT-7948) - State changes of systemd services during agent run are now properly registered (CFE-3753) - Stopped enforcing permissions of modules in inputs This change removes explicit enforcement of permissions for modules in inputs. Instead of explicitly enforcing permissions in inputs, we rely on the default permissions (600). The previous explicit permissions (755) are un-necessary as modules are not executed from within the inputs directory and have resulted in permission flip-flopping in some environments. Permissions on modules in the modules dir (sys.workdir)/modules are still enforced. (ENT-7733) - Switched from using package_method generic to default package_module for windows software inventory (ENT-2589) - Improved the reliability when detecting a Red Hat system. Now if the ID field in /etc/os-release is set to rhel, the redhat_pure class will be defined. If the variable sys.os_release does not exist, redhat_pure is defined if we have already defined redhat and we do not find classes for well known derivatives - rocky, a class defined on Rocky Linux was added to the list of well known derivatives (ENT-7628) - Added advisory lock for Federated Reporting operations (ENT-7474) - controls/cf_serverd.cf no longer specifies explicit default for bindtointerface and relies on the default binding to both :: and 0.0.0.0 on IPV6-enabled hosts (ENT-7362) - setup-status.json is no longer being repaired over and over on FR feeder hubs (ENT-7967) 3.18.0: - Added .ps1 to list of file patterns considered during policy update (ENT-4094) - Added ability to specify additional directories to add autorun policy from (CFE-3524) - Added default cf_version_release of 1 when sys var missing (ENT-6219) - Added description of psql_lock_wait_before_acquisition measurement (ENT-6841) - Added inventory of Setgid files and Setgid files that are root owned (ENT-6793) - Added inventory of users and hosts allowed to use cf-runagent (ENT-6666) - Added measurement of entropy available on linux systems (ENT-6495) - Added missing packages modules scripts in makefile (ENT-6814) - Added new interface for controlling users allowed to initiate cf-agent via cf-runagent (CFE-3544) - Added policy for permissions on cf-execd sockets on Enterprise Hubs (ENT-6777) - Added redirect to remove index.php from Mission Portal's URL (ENT-6464) - Added standalone self upgrade capability for Windows agents (ENT-6219, ENT-6823) - Added tail & tail_n to standard library (CFE-3558) - Added vars.mpf_admit_cf_runagent_shell to control admission for cf-runagent requests (ENT-6673) - Added verbose logfile for msiexec package module file installs (ENT-6220, ENT-6824) - Changed default behavior of policy update to keep inputs in sync with masterfiles Prior to this change, the default behavior of the MPF was to only ensure that files in masterfiles were up to date with the files in inputs. Files in inputs that did not exist in masterfiles were left undisturbed. To enable sync behavior (a common user expectation) you had to explicitly define 'cfengine_internal_purge_policies'. Now, if you wish to return to the previous default behavior, define the class 'cfengine_internal_purge_policies_disabled'. Ticket: (CFE-3662) - Changed msiexec package module install logs to be unique for each msi file (ENT-6824) - Disabled TLSv1 by default for Mission Portal's web server (ENT-6783) - Do not apply redirect from index.php to internal APIs (ENT-6464) - Enabled packages promises using package_module without bundle def (CFE-3504) - Fixed ability to define users authorized for using cf-runagent on policy servers (CFE-3546) - Fixed alpine apk packages module to parse names properly (CFE-3585) - Fixed cfengine_mp_fr_handle_duplicate_hostkeys class usage in policy (ENT-7094) - Fixed docs describing xdev behavior in depth_search bodies (CFE-3541) - Fixed loading of platform specific inventory on AIX (CFE-3614) - Made Enterprise CMDB data update after policy update (ENT-6788) - Prevent setgid files from causing continual repair related to setuid file inventory (ENT-6782) - Removed stale unused copy of u_kept_successful_command body. If you receive an error about undefined body, alter your policy to use kept_successful_command instead (CFE-3617) - Removed unused plugins directory (CFE-3618) - Renamed python symlink to cfengine-selected-python (CFE-3512) - Shortened Inventory OS attribute to be more readable (ENT-6536) - Suppressed inform output from Enterprise Hub database maintenance operations (ENT-6563) - Suppressed output from watchdog on AIX to prevent the mail spool from filling up (CFE-3630) - Added ability to specify a list of bundles to run before autorun (for classification) (ENT-6603) - Update policy now moves obstructions (CFE-2984) - Use VBScript to enumerate installed packages (ENT-4669) - add /usr/bin/yum to paths.cf for aix (CFE-3615) - service status on FreeBSD now uses onestatus (CFE-3515) - Guard again enforcing root ownership for CFEngine files on Windows (ENT-4628) 3.17.0: - Added .csv to the list of file extensions considered by default during policy update (CFE-3425) - Added ability to extend known paths without modifying vendored policy (CFE-3426) - Added apk package module support for alpinelinux (CFE-3451) - Added bundle edit_line converge_prepend with same behavior as bundle edit_line converge, but inserting at start of content. (CFE-3483) - Added inventory for Timezone and GMT Offset (ENT-6161) - Added inventory for policy servers (ENT-6212) - Added maintenance policy to update health diagnostics failures table on enterprise hubs (ENT-6228) - Added optional handle duplicates step in federated reporting import (ENT-6035) - Added replace_uncommented_substrings (ENT-6117) - Added service states "active" and "inactive" for systemd (ENT-6074) - Added watchdog for Windows (ENT-5538) - Adjusted package_module and paths for termux platform (CFE-3288) - Aligned systemd services behavior for service_policy => "enable|enabled|disable|disabled" (ENT-6073) - Changed bundle server access_rules to mpf_default_access_rules (CFE-3427) - Cleaned up Mission Portal OS variable (inventory_os.description) on RHEL 5 & 6 (ENT-6124) - De-duplicated license headers (ENT-6040) - Fixed converge edit_line bundle not deleting lines containing marker (CFE-3482) - Fixed interpretation of cf-hub --show-license from REPAIRED to KEPT (ENT-6473) - Inventory OS variable (inventory_os.description in policy) is now based on os-release - Made git_stash only stash untracked files when capable (CFE-3383) - Moved systemd service management to own bundle (CFE-3381) - Removed delay in refreshing software installed inventory (ENT-6154) - Removed unnecessary packages promise on SuSE (ENT-5480, ENT-6375) - Replaced @ignore with useful doc strings (CFE-3378) 3.16.0: - /var/cfengine/bin/python symlink creation on SLES was fixed - Added 'data' shortcut to cf-serverd, defaults to sys.workdir/data - Added inventory for CFEngine Enterprise License information (ENT-5089, ENT-5279) - Added inventory of NFS servers in use (from /proc/mounts, on linux) (CFE-3259) - Added inventory of license owner on enterprise hubs (ENT-5337) - Added paths support for opensuse (CFE-3283) - Added use of services promise for FR PostgreSQL reconfig in case of systemd (ENT-5420) - Added zypper as default package manager for opensuse (CFE-3284) - Admitted ::1 as a query source on Enterprise hubs (ENT-5531) - Aligned unattended self upgrade package map with current state (ENT-6010) - Always copy modules from masterfiles (CFE-3237) - Changed DocumentRoot of Mission Portal in httpd.conf to `/path/to/cfengine/httpd/htdocs/public` (ENT-5372) - Changed group for state dir files promise to match defaults per OS (CFE-3362) - Changed m_inventory dumping behavior to exclude when values is null (ENT-5562) - Corrected application/logs path to outside of docroot (ENT-5255) - Deleted deprecated __PromiseExecutionsLog from process that cleans log tables (ENT-5170) - Fixed dmi inventory to prefer sysfs to dmidecode for most variables for improved performance and to handle CoreOS hosts that don't have dmidecode. (CFE-3249) - Fixed permission flipping when policy analyzer is enabled (ENT-5235) - Fixed runalerts processes promise on non-systemd systems (ENT-5432) - Fixed selection of standard_services when used from non-default namespace (ENT-5406) - Fixed system UUID inventory for certain VMWare VMs where dmidecode gives UUID bytes in wrong order. (CFE-3249) - Fixed typo preventing recommendation bundles from running (CFE-3305) - HA setups no longer have flipping permissions on /opt/cfengine/notification_scripts - Improved resilience of cron watchdog for linux (CFE-3258) - Inventory refresh is no longer part of agent run on the hub (ENT-4864) - Made python symlink fall back to platform-python (CFE-3291) - Made set_variable_values_ini prefer whitespace around = (CFE-3221) - Modified cftransport cleanup to avoid errors (ENT-5555) - Moved 'selinux_enabled' class to config bundle and namespace scope it - Prevented inventory of unresolved variables for diskfree and loadavg (ENT-5190) - Release number was added to MPF tarballs (ENT-5429) - Standard services now considers systemd services in ActiveState=activating active (CFE-3238) - Stopped continual repair of ha_enabled semaphore (ENT-4715) - Stopped disabling disabled systemd unit each run when disabled state requested (CFE-3367) - Stopped trying to edit fields in manage_variable_values_ini (CFE-3372) - Suppressed useless inform output from /bin/true in ec2 inventory (ENT-5233) - Switched from hardcoded path to /bin/true to use paths from stdlib (ENT-5278) - The zypper module is now fully compatible with Python 3 (CFE-3364) - Whitespace is now allowed at the beginning of ini key-values (CFE-3244) - apt_get package module now checks package state (CFE-3233) 3.15.0: - Added package_module for snap (CFE-2811) - Fixed pkgsrc in case where multiple Prefix paths are returned for pkg_install (CFE-3152) - Fixed pkgsrc module on Solaris/NetBSD (CFE-3151) - Moved zypper package module errors to the cf-agent output (CFE-3154) - Added new class mpf_enable_cfengine_systemd_component_management to enable component management on systemd hosts. When defined on systemd hosts policy will render systemd unit files in /etc/systemd/system for managed services and that all units are enabled unless explicitly disabled. When this class is not defined on systemd hosts the policy will not actively mange cfengine service units (no change from previous behavior) (CFE-2429) - Fixed detection of service state on FreeBSD (CFE-3167) - Added known paths for true and false on linux (ENT-5060) - Fixed path for restorecon on redhat systems to /sbin/restorecon - Added usermod to known paths for redhat systems - Added policy to manage federated reporting with CFEngine Enterprise - Introduced augments variable `control_hub_query_timeout` to control cf-hub query timeout. (ENT-3153) - Added OOTB inventory for IPv6 addresses (sans ::1 loopback) (ENT-4987) - Added and transitioned to using master_software_updates shortcut in self upgrade policy (ENT-4953) - Added brief descriptions to bodies and bundles in cfe_internal/CFE_cfengine.cf (CFE-3220) - Added support for SUSE 11, 12 in standalone self upgrade (ENT-5045, ENT-5152) - Changed policy triggering cleanup of __lastseenhostlogs to target only 3.12.x, 3.13.x and 3.14.x. From 3.15.0 on the table is absent. (ENT-5052) - Fixed agent disabling on systemd systems (CFE-2429, CFE-3416) - Ensured directory for custom action scripts is present (ENT-5070) - Excluded Enterprise federation policy parsing on incompatible versions (CFE-3193) - Extended watchdog for AIX (ENT-4995) - Fixed cleanup of future timestamps from status table (ENT-4331, ENT-4992) - Fixed re-spawning of cf-execd or cf-monitord after remediating duplicate concurrent processes (CFE-3150) - Replaced /var/cfengine with proper $(sys.*) vars (ENT-4800) - Fixed selection of standard_services when used from non-default namespace (ENT-5406) 3.15.0b1: - Added continual checking for policy_server state (CFE-3073) - Added monitoring for PostgreSQL lock acquisition times (ENT-4753) - Added support for 'awk' filters in the FR dump-import process (ENT-4839) - Added support for configuring abortclasses and abortbundleclasses via augments (ENT-4823) - Added support for filtering in both dump and import phases of the FR ETL process (ENT-4839) - Added support for ordering FR awk and sed scripts (ENT-4839) - Added support for setting periodic package inventory refresh interval via augments (CFE-2771) - Changed FR policy to honor target_state properly (ENT-4874) - Copy .awk and .sed files from masterfiles to inputs (ENT-4839) - Fixed Python 3 incompatibility in yum package module - Fixed synchronization of important configuration files from active to passive hub (ENT-4944) - Made keys of all types from feeder hubs trusted on a superhub (ENT-4917) - Speeded-up FR import process by merging INSERT INTO statements (ENT-4839) - Suppressed stderr output from lldpctl when using path defined by def.lldpctl_json (CFE-3109) - Added SQL to update feeder update timestamp during import (ENT-4776) - Added ssh_home_t type to cftransport .ssh dir (ENT-4906) - fix use of _stdlib_path_exists_in FR transport_user policy bundle (ENT-4906) - partitioned __inventory table for federated reporting (ENT-4842) - psql_wrapper needed full path to psql binary (ENT-4912) - yum package_module gets updates available from online repos if local cache fails (CFE-3094) 3.14.0: - Fixed isvariable syntax error in update_def.cf (CFE-2953) - Added path support for setfacl, timedatectl and journalctl (CFE-3013) - Added trailing slash to access promises expecting directories (CFE-3024) - Added scripts and templates for Federated Reporting (ENT-4473) - rpm python module is no longer required to check zypper version - Changed cleanup consumer status SQL query (ENT-4365) - Conditioned use of curl for ec2 metadata cache on curl binary being executable (CFE-3049) - Added augments variables to control cf-hub (ENT-4269) - Prevented DB maintenance tasks on a passive High Availability hub (ENT-4706) - Repair outcome for starting cf-monitord or cf-execd is no longer suppressed (CFE-2964) - Restrictive permissions on hub install log are now enforced (ENT-4506) - Ensured that asynchronous query API semaphores are writable (ENT-4551) - Fixed standalone_self_upgrade not triggering because of stale data (ENT-4317) - Fixed maintenance policy for promise log cleanup to respect history_length_days (ENT-4588) - Improved efficiency and error handling of user specified policy update bundle - Log version of Enterprise agent outside of state (ENT-4352) - Added package module for managing windows packages using msiexec (ENT-3719) - Prevented inventorying un-expanded memory values from cf-monitord (ENT-4522) - Prevented performance overhead on hubs that don't enable license utilization logging (ENT-4333) - Collection status records in the future are now purged (ENT-4362) - Reduced cost of knowing when setopt is available in yum (CFE-2993) - runalerts is now restarted if modified (ENT-4273) - Separated kill signals from restart class to avoid warning (CFE-2974) - Separated termination and observation promises for cf-monitord (CFE-2963) - Set default access promises for directories to only share if directory exists (CFE-3060) - Set default value for purge_scheduled_reports_older_than_days (ENT-4404) - Added more accurate and descriptive daemon classes - collect_window in body server control can now be set from augments (ENT-4283) - Guarded vars promises in cfe_internal_enterprise_mission_portal_apache Constrain vars promises in cfe_internal_enterprise_mission_portal_apache to policy_server.enterprise_edition::, otherwise "cf-promises --show-vars" includes a dump of the entire datastate from the "data" variable in cfe_internal_enterprise_mission_portal_apache (line over 100K long). (CFE-3011) - redhat_pure is no longer defined on Fedora hosts (CFE-3022) 3.13.0: - Add Debian 9 to the self upgrade package map (ENT-4255) - Add 'system-uuid' to default dmidecode inventory (CFE-2925) - Add inventory of AWS EC2 linux instances (CFE-2924) - Add ubuntu 18 to package map for self upgrade (ENT-4118) - Allow dmidefs inventory to be overridden via augments (CFE-2927) - Analyze yum return code before parsing its output (CFE-2868) - Fixed issue when promise to edit file that does not exist caused "promise not kept" condition (ENT-3965) - Avoid trying to read /proc/meminfo when it doesn't exist (CFE-2922) - Avoid use of $(version) for package_version in legacy implementation (ENT-3963) - Cleanup old report data relative to the most recent changetimestamp (ENT-4807) - Clear `__lastseenhostslogs` every 5 minutes. (ENT-3550) - Configure Enterprise hub pull collection schedule via augments (ENT-3834) - Configure agent_expireafter from augments (ENT-4308) - Create desired version tracking data when necessary (ENT-3937) - Cron based watchdog for cf-execd on AIX (ENT-3963) - Detect systemd service enablement for non native services (CFE-2932) - Document how def.acl is used and how to configure it (CFE-2861) - Fix augments control state paths to work on windows (ENT-3839) - Fix package_latest detecting larger version in some cases (CFE-1743) - Fix standalone self upgrade when path contains spaces (ENT-4117) - Fix unattended self upgrade on AIX (ENT-3972) - Fix services starting on windows (ENT-3883) - Improve performance of enterprise license utilization logging - Inventory Memory on HPUX (ENT-4188) - Inventory Physical Memory MB when dmidecode is found (CFE-2896) - Inventory Setuid Files (ENT-4158) - Inventory memory on Windows (ENT-4187) - Make recommendations about postgresql.conf (ENT-3958) - Only consider files that exist for rotation (ENT-3946) - Prevent noise when a service that should be disabled is missing. (CFE-2690) - Prevent standalone self upgrade from triggering un-necessarily (ENT-4092) - Remove Design Center related policies Design center never left beta and has been deprecated. Supporting policies have been removed. If you wish to continue using design center sketches you must incorporate them into inputs and the bundlesequence manually. (ENT-4050) - Remove unicode characters (ENT-3823) - Remove templates for deprecated components (ENT-3781) - Remove un-necessary agent run during self upgrade (ENT-4116) - Slackware package module support (CFE-2827) - Specify scope => "namespace" when using persistent classes (CFE-2860) - Store the epoch of packages in cache db with zypper - Sync cf-runalerts override unit template with package (ENT-3923) - Update policy can now skip local copy optimization on policy servers (CFE-2932) - Updated yum package module to take arbitrary options (ENT-4177) - Use default for package arch on aix (ENT-3963) - Use rpmvercmp for version comparison on AIX (ENT-3963) - Users allowed to request execution via cf-runagent can be configured (ENT-4054) - apt_get package module includes held packages when listing updates (CFE-2855) 3.12.0b1: - Avoid executing self upgrade policy unnecessarily (ENT-3592) - Add amazon_linux class to yum package module - Introduce ability to set policy update bundle via augments (CFE-2687) - Localize delete tidy in ha update policy (ENT-3659) - Improve context notifying user of missing policy update bundle (ENT-3624) - Configure ignore_missing_inputs and ignore_missing_bundles via augments (CFE-2773) - Change class identifying runagent initiated executions from cfruncommand to cf_runagent_initiated - Support enablerepo and disablerepo options in yum package_module (CFE-2806) - Fix cf-runagent during 3.7.x -> 3.10.x migration (CFE-2776, CFE-2781, CFE-2782) - Makes it possible to tune policy master_location via augments in update policy (ENT-3692) - Fix inventory for total memory on AIX (CFE-2797) - Do not manage redis since it's no longer used (ENT-2797) - Server control maxconnections can be configured via augments (CFE-2660) - Allow configuration of allowlegacyconnects from augments (ENT-3375) - Fix ability for zypper package_module to downgrade packages - Splaytime in body executor control can now be configured via augments (CFE-2699) - Add maintenance policy to refresh events table on enterprise hubs (ENT-3537) - Add apache config for new LDAP API (ENT-3265) - update.cf bundlesequence can be configured via augments (CFE-2521) - Update policy inputs can be extended via augments (CFE-2702) - Add oracle linux support to standalone self upgrade - Add bundle to track component variables to restart when necessary (CFE-2326) - Retention of files found in log directories can now be configured via augments (CFE-2539) - Allow multiple sections in insert_ini_section (CFE-2721) - Add lines_present edit_lines bundle - Schedule in body executor control can now be configured via augments (CFE-2508) - Include scheduled report assets in self maintenance (ENT-3558) - Remove unused body action aggregator and body file_select folder - Remove unused body process_count check_process - Prevent yum from locking in package_methods when possible (CFE-2759) - Render variables tagged for inventory from agent host_info_report (CFE-2750) - Make apt_get package module work with repositories containing spaces in the label (ENT-3438) - Allow hubs to collect from themselves over loopback (ENT-3329) - Log file max size and rotation limits can now be configured via augments (CFE-2538) - Change: Do not silence Enterprise hub maintenance - Ensure HA standby hubs have am_policy_hub state marker (ENT-3328) - Add support for 32bit rpms in standalone self upgrade (ENT-3377) - Add enterprise maintenance bundles to host info report (ENT-3537) - Removed unnecessary promises for OOTB package inventory - Add external watchdog support for stuck cf-execd (ENT-3251) - Be less noisy when a promised service is not found (CFE-2690) - Ignore empty options in apt_get module (CFE-2685) - Add postgres.log to enterprise log file rotation (ENT-3191) - Removed unnecessary support for including 3.6 controls - Fix systemctl path detection - Policy Release Id is now inventoried by default (CFE-2097) - Fix to frequent logging of enterprise license utilization (ENT-3390) - Maintain access to exported CSV reports in older versions (ENT-3572) - cf-execd service override template now only kills cf-execd on stop (ENT-3395) - Fix self upgrade for hosts older than 3.7.4 (ENT-3368) - Avoid self upgrade from triggering during bootstrap (ENT-3394) - Add json templates for rendering serial and multiline data (CFE-2713) - Removed unused libraries and controls - Fixed an error in the file_make_mustache_*, incorrect variable name used (CFE-2714) 3.11.0: - Rename enable_client_initiated_reporting to client_initiated_reporting_enabled - Directories for ubuntu 16 and centos 7 should exist in master_software_updates (ENT-3136) - Fix: Automatic client upgrades for deb hosts - Add AIX OOTB oslevel inventory (ENT-3117) - Disable package inventory via modules on redhat like systems with unsupported python versions (CFE-2602) - Make stock policy update more resilient (CFE-2587) - Configure networks allowed to initiate report collection (client initiated reporting) via augments (#910) (CFE-2624) - apt_get package module: Fix bug which prevented updates from being picked up if there was more than one source listed in the 'apt upgrade' output, without a comma in between (CFE-2605) - Enable specification of monitoring_include via augments (CFE-2505) - Configure call_collect_interval from augments (enable_client_initiated_reporting) (#905) (CFE-2623) - Add templates shortcut (CFE-2582) - Behaviour change: when used with CFEngine 3.10.0 or greater, bundles set_config_values() and set_line_based() are appending a trailing space when inserting a configuration option with empty value (CFE-2466) - Add default report collection exclusion based on promise handle (ENT-3061) - Fix ability to select INI region with metachars (CFE-2519) - Change: Verify transferred files during policy update - Change select_region INI_section to match end of section or end of file (CFE-2519) - Add class to enable post transfer verification during policy updates - Add: prunetree bundle to stdlib The prunetree bundle allows you to delete files and directories up to a specified depth older than a specified number of days - Do not symlink agents to /usr/local/bin on CoreOS (ENT-3047) - Add: Ability to set default_repository via augments - Enable settig def.max_client_history_size via augments (CFE-2560) - Change self upgrade now uses standalone policy (ENT-3155) - Fix apt_get package module incorrectly using interactive mode - Add ability to append to bundlesequnece with def.json (CFE-2460) - Enable paths to POSIX tools by default instead of native tools - Remove bundle agent cfe_internal_bins (CFE-2636) - Include previous_state and untracked reports when client clear a buildup of unreported data (ENT-3161) - Fix command to restart apache on config change (ENT-3134) - cf-serverd listens on ipv4 and ipv6 by default (CFE-528) - FixesMake apt_get module compatible with Ubuntu 16.04 (CFE-2445) - Fix rare bug that would sometimes prevent redis-server from launching - Add oslevel to well known paths (ENT-3121) - Add policy to track CFEngine Enterprise license utilization (ENT-3186) - Ensure MP SSL Cert is readable (ENT-3050) 3.10.0: - Add: Classes body tailored for use with diff - Change: Session Cookies use HTTPOnly and secure attributes (ENT-2781) - Change: Verify transferred files during policy update - Add: Inventory for system product name (model) (ENT-2780) - Add: Ensure appropriate permissions for SSL files (ENT-760) - Fix rare bug that would sometimes prevent redis-server from launching. - Change: Enable strict transport security - Add: Definition of from_cfexecd for cf-execd initiated runs (CFE-2386) - Add testing jUnit and TAP bundles and include them in stdlib.cf - Change: Rename duplicate bodies in ha_update.cf (ENT-2753) - Change: Disable RC4 Cipher for ssl in Mission Portal - Pass package promise options to underlying apt-get call (#802) (CFE-2468) - Change: Enable agent component management policy on systemd hosts (CFE-2429) - Add: Enterprise appliaction log dir to rotation - Change: re-enable hub process maintenance - Add: edit_line contains_literal_string to stdlib - Fix: Services starting or stopping unnecessarily (CFE-2421) - Allow specifying agent maxconnections via def.json (CFE-2461) - Change: Disable http TRACE method - Change: Reduce Enteprise webserver info - Change: cronjob bundle tolerates different spacing - Fix: CFEngine choking on standard services (CFE-2806) - Change select_region INI_section to match end of section or end of file (CFE-2519) - Fix ability to manage INI sections with metachars for manage_variable_values_ini and set_variable_values_ini (CFE-2519) - Fix apt_get package module incorrectly using interactive mode. - Add ability to append to bundlesequnece with def.json (CFE-2460) - Behaviour change: when used with CFEngine 3.10.0 or greater, bundles set_config_values() and set_line_based() are appending a trailing space when inserting a configuration option with empty value. (CFE-2466) 3.7.0: - Support for user specified overriding of framework defaults without modifying policy supplied by the framework itself (see example_def.json) - Support for def.json class augmentation in update policy - Run vacuum operation on PostgreSQL every night as a part of maintenance. - Add measure_promise_time action body to lib (3.5, 3.6, 3.7, 3.8) - New negative class guard `cfengine_internal_disable_agent_email` so that agent email can be easily disabled by augmenting def.json - Relocate def.cf to controls/VER/ - Relocate update_def to controls/VER - Relocate all controls to controls/VER - Only load cf_hub and reports.cf on CFEngine Enterprise installs - Relocate acls related to report collection from bundle server access_rules to controls/VER/reports.cf into bundle server report_access_rules - Re-organize cfe_internal splitting core from enterprise specific policies and loading the appropriate inputs only when necessary - Moved update directory into cfe_internal as it is not generally intended to be modified - services/autorun.cf moved to lib/VER/ as it is not generally intended to be modified - To improve predictibility autorun bundles are activated in lexicographical order - Relocate services/file_change.cf to cfe_internal/enterprise. This policy is most useful for a good OOTB experience with CFEngine Enterprise Mission Portal. - Relocate service_catalogue from promises.cf to services/main.cf. It is intended to be a user entry. This name change correlates with the main bundle being activated by default if there is no bundlesequence specified. - Reduce benchmarks sample history to 1 day. - Update policy no longer generates a keypair if one is not found. (Redmine: #7167) - Relocate cfe_internal_postgresql_maintenance bundle to lib/VER/ - Set postgresql_monitoring_maintenance only for versions 3.6.0 and 3.6.1 - Move hub specific bundles from lib/VER/cfe_internal.cf into lib/VER/cfe_internal_hub.cf and load them only if policy_server policy if set. - Re-organize lib/VER/stdlib.cf from lists into classic array for use with getvalues - inform_mode classes changed to DEBUG|DEBUG_$(this.bundle):: (Redmine: #7191) - Enabled limit_robot_agents in order to work around multiple cf-execd processes after upgrade. (Redmine #7185) - Remove Diff reporting on /etc/shadow (Enterprise) - Update policy from promise.cf inputs. There is no reason to include the update policy into promises.cf, update.cf is the entry for the update policy - _not_repaired outcome from classes_generic and scoped_classes generic (Redmine: # 7022) - standard_services now restarts the service if it was not already running when using service_policy => restart with chkconfig (Redmine #7258) - Fix process_result logic to match the purpose of body process_select days_older_than (Redmine #3009)
Enterprise changelog
See also: Core changelog, Masterfiles changelog
3.23.0: - Added cleanup of shared host groups data on deletion or when a shared group is made personal (ENT-10417) - Added collection of information from pg_stat_activity to cf-support (ENT-10730) - The UI now remembers the chosen number of groups per page (ENT-10368) - Adjusted ldap queries to include only login_attribute and group_attribute instead of default-set (ENT-10408) - Clarified what "handle" means in comment for __monitoringmgmeta.observable (ENT-10393) - Disabled groups app in case of no inventory (ENT-10461) - Fixed Inventory API failure when there is a colon in the class filter value (ENT-10389) - Fixed groups class filters having dots when they should have underscores (ENT-10377) - Fixed modal include/exclude hosts pagination (ENT-10380) - Fixed pagination bug in include/exclude by hostkey (ENT-10380) - Fixed paginator to handle more than 5 pages (ENT-10380) - Fixed syntax highlighting/colors in policy analyzer (ENT-10650) - Improved locale override in masterfiles stage scripts (ENT-10753) - Improved performance of software update alert SQL query for large tables (ENT-10752) - Now using the raw value of vars in inventory reports (ENT-4277) - Added simplistic IP-address classes on Windows (ENT-2044) - Renamed hostsFilter Inventory API parameter to hostFilter (ENT-10363) - Implemented hosts including/excluding by inventory attributes (ENT-9959) - Guarded against invalid input syntax for type numeric during federated reporting import process (ENT-10906) - Fixed potential deadlock between cf-reactor single host inventory update and federated reporting import process (ENT-10906) - Fixed federated reporting schema lock not operating properly (ENT-10906) - Added anonymous bind option for LDAP Authentication Settings (ENT-10403) - Addressed SQL injection vulnerability in Mission Portal (ENT-10622, CVE-2023-45684) Packaging changes: - Added better handling of postgresql server state during hub package install (ENT-10647) - Fixed and improved postgresql server state handling in package scriptlets (ENT-10647) - Fixed issue with using pg_upgrade on ubuntu-16 hub installer upgrade (ENT-10710) - Guarded against race condition in install scriptlets with restorecon (ENT-10429) - Improved locale env vars safety during installation for postgresql (ENT-10739) - Updated apache from 2.4.57 to 2.4.58 - Updated git from 2.41.0 to 2.42.1 - Updated libcurl from 8.1.2 to 8.4.0 - Updated libcurl-hub from 8.1.2 to 8.4.0 - Updated libxml2 from 2.11.4 to 2.11.5 - Updated lmdb from 0.9.30 to 0.9.31 - Updated openldap from 2.6.4 to 2.6.6 - Updated openssl from 3.1.1 to 3.1.4 - Updated php from 8.2.7 to 8.2.12 - Updated postgresql from 15.3 to 15.5 - Updated zlib from 1.2.13 to 1.3 3.22.0: - Added host groups application (ENT-9482) - Added host groups API (ENT-9772) - Added shared host groups CMDB API (ENT-9483) - Added additional host inventory API filter and context filters applied directly to the query (ENT-9773) - Added database comments for __monitoringmgmeta and __monitoringmg table columns (ENT-9796) - Added possibility to set OR condition in the Inventory API filters (ENT-8916) - Added support of string module input type in the MP UI (ENT-9854) - Changed various widgets to a more appropriate graph type, line graphs(ENT-9522) - Changed style of not reported pinned items on host info page (ENT-9589) - Denied custom PostgreSQL functions execution except for authorized ones (ENT-9826) - Disabled LDAP functions on macOS platform (ENT-9871, ENT-9878) - Fixed class finder input search in Firefox (ENT-10244) - Fixed compliance by category chart config changing on export (ENT-9522) - Fixed host info page ignoring URL parameter and opening host from the saved cookie (ENT-10232) - Fixed refreshing host specific measurement page takes to the host info page (ENT-9792) - Hostname now links to host info page instead of the same target as "View report" button in the alert status table (ENT-10272) - Implemented new modal based UI for adding columns in inventory report (ENT-9481) - Improved speed of update_inventory procedure to avoid empty FR dumps (ENT-10214) - Replaced old gifs and images in Mission Portal (ENT-8580) - The child process of cf-hub that is responsible for running scheduled reports now connects to the DB as the cfapache user and thus with limited access (ENT-9825) - Updated dark mode welcome tour images (ENT-9913) Packaging changes: - Added cfengine-enterprise SELinux module source files and instructions (ENT-9685) - Added rpm requires for selinux-policy version we build with (ENT-9685) - Updated Apache from 2.4.54 to 2.4.57 - Updated apr from 1.7.0 to 1.7.4 - Updated apr-util from 1.6.1 to 1.6.3 - Updated diffutils from 3.8 to 3.10 - Updated git from 2.38.1 to 2.41.0 - Updated libcurl from 7.86.0 to 8.1.2 - Updated libcurl-hub from 7.86.0 to 8.1.2 - Updated libxml2 from 2.10.3 to 2.11.4 - Updated lmdb from 0.9.29 to 0.9.30 - Updated openldap from 2.6.3 to 2.6.4 - Updated openssl from 3.0.7 to 3.1.1 - Updated php from 8.1.12 to 8.2.7 - Updated postgresql from 15.1 to 15.3 3.21.0: - Added Build API call to check if a project is synchronised with VCS settings (ENT-9666) - Added Build module input UI and API (ENT-8927) - Added a newline to the end of API responses body (ENT-9355) - Added cf-enterprise-support script to be sourced by cf-support (ENT-9037) - Added editable fields component to dashboard and compliance report titles (ENT-9449) - Added favicon (ENT-7728) - Added functionality to delete Build projects (ENT-9015) - Added libpq notice receiver to redirect notices to logger (ENT-3966) - Added options for lower frequency reminders down to 1 minute (ENT-3599) - Added possibility to deploy Build projects locally (ENT-8972) - Added possibility to send base64 encoded modules names to the Build API (ENT-9345) - Added weekly reminder intervals up to 4 weeks (ENT-9510) - Adjusted reports page styles (ENT-9016) - Allowed multiple Build local projects creation (ENT-9460) - Allowed to insert JSON array into CMBD variable data container (ENT-9635) - Build modules are now shown as external when they are added from URL or local files (ENT-9345) - Changed compliance score calculation logic (ENT-8923) - Changed host info page content (ENT-8392) - Changed owner of OTTB reports to CFE_ROBOT (ENT-8260) - Changed owner of out-of-the-box reports from admin to CFE_ROBOT system user (ENT-8260) - Changed verified registry settings from info to verbose log level (ENT-9575) - Do not include LDAP groups in Mission portal users roles (ENT-9588) - Empty string as the rbac.filter value no longer causes NOTICE messages in PostgreSQL logs (ENT-8253) - Enabled compliance report importing if an inventory attribute is not reported (ENT-9023) - Filtered out software available updates which intersect with installed software versions (ENT-9632) - Fixed Build API updating is_empty (ENT-8977) - Fixed Build API not returning 404 status when a module is not found - Fixed Build module deletion request without the request body - Fixed cases where update button was not displayed for Build in MP (ENT-9538) - Fixed changes report displaying encoded special chars (ENT-9542) - Fixed compliance report importing when long list of conditions (ENT-9089) - Fixed creating dashboard rules with long names or descriptions (ENT-9089) - Fixed dismissed health diagnostic hosts list when no limit or offset passed (ENT-9532) - Fixed edit user empty dialog when a role has edit user permission (ENT-9475) - Fixed external Build modules removing and displaying in the added modules list (ENT-9345) - Fixed git_cfbs_deploy_refspec in masterfiles_stage leaving temp dir (ENT-9039) - Fixed multi-alert widget destroyed if navigate to alternate dashboard while attaching conditons (ENT-9591) - Fixed viewing or editing roles by users who have corresponding RBAC permissions (ENT-9639) - Implemented new UI for exporting compliance reports (ENT-9138) - Implemented possibility to create multiple Build projects (ENT-9015) - Improved UI for displaying LDAP users and roles (ENT-9588) - Moved ldap_log to application directory where it belongs (ENT-9693) - Moved log messages for windows services about already being in desired state from info to verbose (ENT-9569) - Processes promises now log verbose instead of info when not sending signals on windows (ENT-9574) - Removed 'Failed checks by severity' compliance widget (ENT-8922) - Removed resize and full screen widgets buttons (ENT-8914) - Renamed HA status top menu to Hub and extended with hub information (ENT-9610) - Renamed health diagnostics to be more user friendly (ENT-9523) - Replaced badly scaled dark mode Build logo in Build in MP (ENT-8974) - Replaced the badly scaled Build logo (ENT-8974) - Replaced the compliance widget image with lighter background. (ENT-9404) - Views applying RBAC can now be used even in DB sessions where rbac.filter is not set in which case it is considered to be empty (no filtering) (ENT-9637) - 404 status code is now returned when a page is not found (ENT-8559) Packaging changes: - Add Debian 11 aarch64 labels (ENT-8978) - Added cf-support binary to packages (ENT-9037) - Added Ubuntu 22 hub and agent packages (ENT-8479) - Installer will now skip removing cfengine-enterprise SELinux module if not installed (ENT-9594) - Updated Apache from 2.4.53 to 2.4.54 - Updated Git from 2.36.1 to 2.38.1 - Updated libcurl from 7.83.1 to 7.86.0 - Updated libiconv from 1.17 to 1.17 - Updated libxml2 from 2.10.3 to 2.9.1 - Updated OpenLDAP from 2.6.2 to 2.6.3 - Updated OpenSSL from 3.0.4 to 3.0.7 - Updated PHP from 8.1.7 to 8.1.12 - Updated PostgreSQL from 14.3 to 15.1 - Updated rsync from 3.2.4 to 3.2.7 - Updated SASL2 from 2.1.27 to 2.1.28 - Updated zlib from 1.2.12 to 1.2.13 3.20.0: - Mission Portal now has a new CFEngine Build application. This application allows you to combine multiple modules from build.cfengine.com into 1 project and subsequently deploy this project as a policy set on your hub. - Added compliance reports widget (ENT-8081) - Various parts of the UI was improved, especially dark mode and reports interfaces - Fixed export of ootb compliance reports - Compliance checks without a report are no longer imported (ENT-8259) - The import/export user interface now shows the settings menu on the left (ENT-8044) - CFEngine now runs cf-reactor, an event reaction daemon (ENT-7357) - Inventory refresh requests are now handled by cf-reactor not cf-hub (ENT-8307) - Host specific data in the __cmdb table is now deleted on host deletion (ENT-8570) - Fixed problems related to empty / NULL values in CMDB data (ENT-8406) - Added validation to exclude CFEngine variables from CMDB values (ENT-7468) - Fixed 'Inventory attribute not found' error while compliance report importing (ENT-8480) - Fixed false positive report email sending status (ENT-8046) - "info: New hosts discovered..." is no longer falsely reported by cf-hub (ENT-8422) - Made Meta tags field available for classes and variables in Report Builder (ENT-790, ENT-5568) - Made PromiseLog table available in Report Builder (ENT-7290) - Added comments on __PromiseLog table (ENT-8267) - Added comments for __contexts and __contextslog PostgreSQL tables (ENT-8389) - Adjusted cfdb schema to allow upgrades (ENT-7505) - An agent run is now triggered when FR hub state is changed (ENT-7965) - Reduced exclusive lock time during FR import (ENT-8727) - Feeder's data is now removed on feeder deletion (ENT-7970) Packaging changes: - 'cfbs' is now part of enterprise hub packages on platforms with Python 3.5 or newer (ENT-8439) - Enterprise hub packages now pull python3 as a (weak) dependency (ENT-8439) - Improve check for 'ss' command on newer debian distros (ENT-8293) - Stopped loading unused Apache modules by default on Enterprise Hubs: mod_actions (ENT-8503), mod_asis (ENT-8505), mod_auth_digest (ENT-8608), mod_authn_anon (ENT-8600), mod_authn_dbd (ENT-8601), mod_authn_dbm (ENT-8599), mod_authn_file (ENT-8598), mod_authnz_ldap (ENT-8512), mod_authz_groupfile (ENT-8603), mod_authz_user (ENT-8604), mod_autoindex (ENT-8514), mod_deflate (ENT-8523), mod_dumpio (ENT-8526), mod_env (ENT-8522), mod_expires (ENT-8610), mod_filter (ENT-8524), mod_include (ENT-8507), mod_ldap (ENT-8509), mod_log_forensic (ENT-8501), mod_mime_magic (ENT-8517), mod_negotiation (ENT-8511), mod_reqtimeout (ENT-8525), mod_spelling (ENT-8499), mod_unique_id (ENT-8519), mod_usertrack (ENT-8521), mod_version (ENT-8497), mod_vhost_alias (ENT-8513), substitute (ENT-8498), mod_info (ENT-8504), mod_status (ENT-8506), mod_webdav (ENT-8495) - Dropped support for CentOS 6 HUB package - Updated git from 2.34.1 to 2.36.1 - Updated rsync from 3.2.3 to 3.2.4 - Updated libcurl from 7.80.0 to 7.83.1 - Updated openldap from 2.6.0 to 2.6.2 - Updated apache from 2.4.51 to 2.4.53 - Updated php from 8.0.12 to 8.1.7 - Updated openssl from 1.1.1l to 3.0.4 - Updated libiconv from 1.16 to 1.17 - Updated postgresql from 13.5 to 14.3 3.19.0: - Added API to get deleted hosts list (ENT-7469) - Added constraint disallowing empty strings for hostkey in __hosts (ENT-8003) - Added hover state to outline buttons (ENT-7399) - Added import/export compliance reports possibility (ENT-6470) - Added inventoryFile parameter to the Hosts by class API (ENT-7664) - Added vcs type dropdown the Version control repository settings (ENT-7710) - Added vcs type parameter to the VCS API (ENT-7710) - Adjusted PDF reports (ENT-7690) - Adjusted host info page styles (ENT-7429) - Changed NOTICE to DEBUG in cfdb schema.sql where appropriate to reduce noise (ENT-3742) - Changed Policy Deployment Alert to target hosts reporting policy_server (ENT-3607) - Changed UI toasts styles (ENT-7455) - Changed dark mode logo (ENT-7398) - Changed images for adding new widgets (ENT-7604) - Changed inventory condition explanations (ENT-7655) - Changed modal dialogs styles (ENT-7509) - Changed reports temporary directory (ENT-7465) - Changed widgets colors in dark mode (ENT-7351) - Check group checkbox when all permissions inside are checked on RBAC settings page (ENT-7229) - Copied masterfiles-stage CFBS changes from core (ENT-7709, ENT-7891) - Fixed Advanced Report filters SQL building (ENT-7520) - Fixed CMDB array textarea wrong value when losing focus with an empty value (ENT-7930) - Fixed adding multiple feeders in a row (ENT-7964) - Fixed adding multiple inventory widgets for the same attribute to a dashboard (ENT-7298) - Fixed issue with cli_tasks not working when HTTPS_PROXY env var set (ENT-7732) - Fixed links in compliance PDF reports (ENT-7366) - Fixed links in compliance PDF reports (ENT-7366) - Fixed tooltip indicating default bundle for CMDB variables was main instead of variables (ENT-7421) - Fixed troubleshooting guidance for host never collected from (ENT-7499) - Fixed typo in received entries from diagnostics table (ENT-7522) - Fixed up monitoring data on nodes (ENT-7353) - Fixed wrong time in changes reports (ENT-7912) - Fixed wrong widget alerts in a newly created dashboard with default widgets (ENT-7949) - Host selection and prioritization for report collection is now deterministic (ENT-5271) - Improved compliance form UX (ENT-7437) - Missing software version no longer causes patch failures in reporting (ENT-7419) - Provided overwrite option in the User management setting when a user exists (ENT-681) - Replaced URLs with links in reports tables (ENT-7694) - Set JS and CSS cache permissions to 0440 (ENT-7261) - Showed IPv4 addresses from inventory on the Hub management (ENT-7232) - Sorted variables and classes alphabetically on the host info page (ENT-7369) - Trigger an agent run after enabling of the Policy analyzer or Federated reporting (ENT-7335) - Use advisory lock for Federated Reporting deadlock avoidance (ENT-7474) - Use advisory lock for Federated Reporting schema changes (ENT-7474) Packaging changes: - Changed 4th octet in Windows package version to match package release number (ENT-7554) - Enforced permissions for Postgres log (ENT-7961) - Moved httpd.pid to root of httpd workdir (ENT-7966) - VCS configuration now works on RHEL 8 hubs (ENT-7898) - Updated pcre from 8.44 to 8.45 - Updated openssl from 1.1.1k to 1.1.1l - Updated diffutils from 3.7 to 3.8 - Updated openldap from 2.5.5 to 2.6.0 - Updated libcurl-hub from 7.77.0 to 7.80.0 - Updated git from 2.32.0 to 2.34.1 - Updated postgresql from 13.3 to 13.5 - Updated libcurl from 7.77.0 to 7.80.0 - Updated apache from 2.4.48 to 2.4.51 - Updated php from 8.0.7 to 8.1.0 3.18.0: - Added API to trigger agent run (ENT-6180) - Added CMDB API (ENT-6785) - Added Health diagnostics condition for multiple identities reporting same host identifier (ENT-6653) - Added breadcrumbs to compliance check reports (ENT-6462) - Added categorization for inventory attributes This change introduces two new inventory attributes: - 'Allowed users for cf-runagent' - 'Allowed hosts for cf-runagent' Two other inventory attributes have been renamed: - 'Kernel', previously referred to as 'OS type' - 'Kernel Release', previously referred to as 'OS kernel' Note: Old agents will continue to report under the old names. (ENT-6742) - Added confirmation window when closing unsaved forms (ENT-6492) - Added database table for hosts-specific CMDB data (ENT-6784) - Added default pin items to users profiles (ENT-6550) - Added description to compliance check tooltip (ENT-6461) - Added hostkey and OS columns to Software Updates alert report (ENT-6545) - Added new column to all hosts compliance check report which tells if a host is passing or failing (ENT-6741) - Added save button when editing compliance report title (ENT-6458) - Added the button to trigger an agent run from the Host info page (ENT-6180) - Changed compliance report URN from `/reports/compliance_report` to `/reports/compliance-report`(ENT-6891) - Changed host specific software installed/available reports (ENT-6771) - Changed redirect after host delete to dashboard (ENT-6427) - Changed reports endpoint URL from `/advancedreports#/` to `/reports/` (ENT-6514) - Cleared session storage before opening inventory report from the host info page to avoid loading previous report (ENT-6467) - Errors when reading cookie values from LMDB no longer cause "Hosts likely using the same identity" false positives (ENT-6476) - Fixed JS errors after clicking alerts widgets (ENT-6547) - Fixed dark theme charts on exported PDF reports (ENT-6739) - Fixed error when navigating back to a report from edit (ENT-6546) - Fixed issue causing report collection failures (ENT-6525) - Fixed plpgsql error in pgschema.sql pin_items_to_existing_users (ENT-6797) - Fixed sys.release for Windows Server 2019 (ENT-4496) - Greyed out items from dropdown after placing into inventory report (ENT-6581) - Hide graphical elements of inventory chart widgets when there are no data (ENT-6526) - Implemented new style of MP header, nav bar and tables (ENT-7085) - Improved UX of regex validation (ENT-6453) - Moved host info page buttons to the title section (ENT-7053) - Ordered categories and compliance checks alphabetically (ENT-6493) - Organized inventory/classes/variables on the host info page (ENT-6496) - Removed IP address from title when zooming in on measurement graphs (ENT-6515) - Removed index.php from URL (ENT-6464) - Send localhost address when triggering agent run on the hub (ENT-7091) - Show host filter in compliance check tooltip (ENT-6738) - cf-hub: Added --ignore-preferred-augments command line option (CFE-3656) - Added restart service policy option for Windows (ENT-4643) Packaging changes: - Added redirect to remove index.php from Mission Portal's URL (ENT-6464) - Do not apply redirect from index.php to internal APIs (ENT-6464) - Enabled sockets in PHP config (ENT-6180) - Fixed broken redirect from http to htttps (ENT-7039) - Removed unused plugins directory (CFE-3518) - Updated libxml2 from 2.9.10 to 2.9.12 - Updated openldap from 2.4.58 to 2.5.5 - Updated libcurl-hub from 7.75.0 to 7.77.0 - Updated apache from 2.4.46 to 2.4.48 - Updated git from 2.31.1 to 2.32.0 - Updated postgresql from 13.2 to 13.3 - Updated php from 8.0.3 to 8.0.7 - Updated libcurl from 7.75.0 to 7.77.0 3.17.0: - Added button and API to trigger report collection for a host (ENT-6179) - Added dark mode to Mission Portal (ENT-6099) - Added copy-to-clipboard buttons in Mission Portal (ENT-5044) - You can now pin inventory, variables, and classes to the host info page (ENT-5571) - Mission portal roles can now be automatically synced using LDAP, for example with Active Directory roles/tags.(ENT-6151) - Added `is reported` and `is not reported` inventory filter conditions (ENT-6190) - Added an ansible-compatible Hosts API endpoint to get hosts grouped by class (ENT-6175) - Added an open report button to inventory widgets (ENT-6143) - Inventory widgets now open filtered reports when clicking items (ENT-6972) - Added regex support to Inventory API, filters and conditions (ENT-6057) - Hosts with reporting issues are now highlighted in other reports (ENT-6228) - Inventory attribute lists are now ordered by name (ENT-6456) - Reports now indicate whether a variable is empty or not reported (ENT-6159) - Query API now preserves null and empty string values from database (ENT-6159) - Added function to remove duplicate hosts (disabled by default) (ENT-6035) - There were several usability improvements to compliance reports UI. Compliance reports are now easier to navigate, more intuitive to edit, and provide a lot more useful information about checks and hosts. (ENT-6047) - Added links to view Passing/Failing/All hosts in compliance reports (ENT-6137) - Compliance checks can now be edited (ENT-6135) - Custom compliance check categories can now be added (ENT-6114) - Added tooltips describing Inventory conditions (ENT-6187) - Total host count in compliance reports now respect host filter (ENT-6054) - Fixed an issue causing `host bootstrapped at` to be unavailable (ENT-6112) - Fixed `Change data type` styles to fit in small elements (ENT-6185) - Fixed `JSON.parse: unexpected character at line 1` JS error (ENT-6052) - Fixed `can't access property 0` JS error on a host page (ENT-6056) - Fixed `hosts never collected from` report by excluding deleted hosts (ENT-6415) - Fixed `remember me` option on the login page and set inactivity time before the next login will be required to 72 hours. (ENT-6106) - Fixed classes modal window overlapping (ENT-6094) - Fixed error in a browser console when clicking on inventory widget (ENT-6141) - Fixed inventory report columns adding when an empty filter has applied (ENT-6499) - Fixed issue where nova_cookies.lmdb wasn't closed for new hosts (ENT-6434) - Fixed a memory corruption/crash when dealing with secondary groups in user promises on windows (ENT-6223) - Fixed toggle button positioning in Firefox (ENT-6145) - Fixed issue causing windows user promises to always repair (ENT-6223, ENT-6379) - Fixed issue when trying to scroll to part 2 of legend in widgets (ENT-6378) Packaging changes: - Use /etc/os-release when detecting latest suse (ENT-5363) - Build packages specific for SUSE/SLES 11,12,15 (ENT-5335, ENT-5363) - Added diffutils 3.7 as vendored dependency (ENT-6373) - RHEL 8 is now a supported platform for CFEngine hubs (ENT-6103) - Updated lmdb from 0.9.24 to 0.9.27 - Updated openssl from 1.1.1g to 1.1.1h - Updated openldap from 2.4.53 to 2.4.56 - Updated git from 2.28.0 to 2.29.2 - Updated postgresql from 12.4 to 13.1 - Updated php from 7.4.10 to 7.4.12 - Updated libcurl from 7.72.0 to 7.73.0 3.16.0: - Added compliance reports Compliance reports allow you to implement custom, high level, reports based on your compliance framework, requirements or regulation (ENT-5559) - 'cf-hub --query' now triggers inventory refresh for the given hosts (ENT-4864) - Added CFEngine role information to the Host info page (ENT-5215) - Added IP address column to `Hosts never collected from` health diagnostic report (ENT-3936) - Added IPAddress column to __hosts table (ENT-5268) - Added ON_ERROR_STOP true to catch SQL errors earlier (ENT-5115) - Added OOTB inventory attributes for CFEngine Enterprise License (ENT-5089) - Added `created by` column to shared dashboard list (ENT-5229) - Added detailed hosts count information (ENT-4783) - Added error message when attempting to collect from a deleted host (ENT-4247) - Added fullscreen mode for widgets (ENT-5381) - Added information to show when scheduled reports will be sent in local time (ENT-5285) - Added inventory table widget to dashboard (ENT-5379) - Added logic to handle bad status/__status table situations (ENT-5396) - Added management of account expiration for Windows user promises (ENT-3116) - Added missing tables to clear_hosts_references() (ENT-5399) - Added possibility to always use browser time in Mission Portal (ENT-5310) - Added possibility to change timezone in user profile (ENT-5214) - Added possibility to clone shared dashboards (ENT-5232) - Added possibility to grant access to see non-reporting hosts - Added possibility to share dashboards with specific users or roles (ENT-5231) - Added reminder about exceeded license limit in Mission Portal (ENT-5082) - Added time_zone property to Users API (ENT-4067) - Added warning when user with no assigned role uses Mission Portal (ENT-4651) - Allowed to create dashboard with not unique name if someone already used this name (ENT-5320) - Changed postgresql connection hostname to use a unix-domain socket by default (ENT-2747) - Deleted hosts are now excluded from report collection Host delete is intended to be used for decommissioned hosts, so this should not be a problem. If you need a host to reappear, generate a new keypair and bootstrap it, as if it was a new host. (ENT-4247) - Deleted hosts now appear in __hosts table with a deletion time stamp (ENT-4247) - Dropped deprecated __PromiseExecutionsLog database table (ENT-5170) - Fixed HTML special characters displaying in Changes report (ENT-5417) - Fixed ProfileModel session usage in tests or CLI - Fixed a crash in cf-hub while applying reporting data (ENT-4409) - Fixed an issue with the client_history_timeout in cf-hub (ENT-4409) - Fixed deselecting Hub Id column in the Query builder when editing a reports (ENT-5200) - Fixed grammar in UI for creating condition based on file change (ENT-5414) - Fixed health diagnostics API parameters validation. Using sent parameters instead of default. - Fixed host search in Mission Portal which was returning "500 - Internal Server Error" (ENT-5250) - Fixed inventory report scheduling when applying filter to a report. (ENT-5167) - Fixed license info in Mission Portal when multiple rows in __hub table (ENT-5556) - Fixed crash (segmentation fault) when cf-hub shuts down - Fixed timing issues causing "patch failure" errors in reporting (ENT-4409) - Hosts deletions are now completed more quickly/frequently (ENT-5092) - Hosts which have not reported yet may now show up in __hosts table with LastReportTimestamp = NULL (ENT-5267) - Inventory attribute list on widget adding was improved: added search box, attribute list was alphabetized and grouped by category. (ENT-5365) - Inventory is now refreshed faster for call-collected hosts (ENT-4864) - Inventory is now refreshed for newly bootstrapped hosts (ENT-4864) - Inventory is now refreshed right after report collection (ENT-4864) - Reduced false positives in 'Last agent run unsuccessful' health check (ENT-4774) - Removed application/logs/index.html (ENT-5255) - Renamed old `Compliance` report category to `Promise outcomes` (ENT-5557) - __hosts table now has IP address information (ENT-5268) - cf-hub --show-license now has exit code 0 for free-25 (ENT-5297) - cf-hub no longer prints many verbose log message for query timeout - cf-hub: Fixed potential buffer overflow when parsing monitoring data Packaging changes: - 'systemctl enable' failure no longer stops the postinstall package scripts (ENT-5188) - Added checks for database state to avoid error messages during install (ENT-5115) - Enabled mbstring PHP extension - Made Mission Portal application log relocation more resilient (ENT-5255) - RHEL 8 CFEngine packages now rely on system OpenSSL libraries (ENT-5564) - Tighten Postgresql access permissions (ENT-2747) - Removed executable bit from unix socket - Removed local TCP access rules - Added OS specification to deb filenames (ENT-5306) - Added OS specification to rpm filenames (ENT-5306) - Added OS specification to solaris filenames (ENT-5306) - All secrets are now stored in secrets.ini file (ENT-5369) - Updated openssl from 1.1.1f to 1.1.1g - Updated libyaml from 0.2.2 to 0.2.5 - Updated openldap from 2.4.49 to 2.4.50 - Updated libcurl-hub from 7.68.0 to 7.70.0 - Updated apache from 2.4.41 to 2.4.43 - Updated git from 2.25.1 to 2.27.0 - Updated postgresql from 12.2 to 12.3 - Updated php from 7.4.2 to 7.4.6 - Updated libcurl from 7.68.0 to 7.70.0 3.15.0: - Added settings page to customize Mission Portal. Available options: Color schema, logo, additional text on the login page. (ENT-4914) - cf-hub can now detect when multiple hosts are using the same hostkey This is done using the new cookie protocol. Randomized cookies are exchanged during each report collection, and if there is a mismatch with the previous cookie, it will show up as alerts in Mission Portal. The health indicator "Hosts likely using the same identity" is now using this system. The previous duplicate host detection system was done entirely in Database and had more false positives. - Admins can now delete hosts which are missing reporting data (ENT-4942) - Hosts that have not reported yet are no longer filtered out when RBAC is disabled (ENT-4712) - Added --show-license option to cf-hub This option prints the license information in a structured and easy to read way. (ENT-4971) - Hub now properly logs an error if license counts are exceeded (ENT-5080) - cf-hub query report collection timeout is now customizable --query-timeout command line option, and query_timeout constraint in body hub control can be used to customize the timeout. Previously it was a hardcoded 30 seconds. (ENT-3153) - Made cf-hub more robust against clients reporting bad timestamps (ENT-5056) - Empty host names in 'cf-hub --query -H' are now skipped (ENT-4866) - Removed unnecessary line endings in reporting protocol. These showed up as `#012#015` and `#015` in logs (escaped), and caused confusion. (ENT-4777) - Added average agent execution interval to the host info page (ENT-4543) - Added average agent execution time for each policy entry to the Host info page (ENT-4542) - Added classes and variables to the Host info page (ENT-3095) - Added first report collection time to the host info page (ENT-4540) - Added host bootstrapped at time to the host info page (ENT-4541) - Added last agent execution time to the host info page (ENT-4539) - Added possibility to see inventory attributes and values on the host info page (ENT-710) - Added report collection methodology to the host info page (ENT-4537) - Added API call to get changed file list (ENT-3316) - Added possibility to filter by inventory attributes in Query API (ENT-4321) - Password entry fields in Mission Portal are now obscured by default, with a button to show password if necessary (ENT-5111) - Added File integrity monitoring report (ENT-3316) - Policy analyzer summary table grouped by promises execution frequency (ENT-4320) - Added hosts and inventory filters to Policy analyzer (ENT-4321) - Added possibility to select JOIN type in Query builder (ENT-4908) - Added scroll to dropdown inventory attributes list (ENT-5074) - Renamed Monitoring to Measurements The Monitoring module in Mission Portal is really data from measurement type promises. Monitoring brings to mind alerting, which we handle as a subset of our Dashboards. This name change clarifies the content. (ENT-5023) - Changed session lock to allow parallel HTTP requests. Previously, the session library would create a lock and not allow new requests until the current one is not finished. This lock was introduced to avoid data overwriting when two or more parallel requests are writing into the same session variable, but this doesn't happen in our code (ENT-4860) - Changed response codes in User API from 204 No Content to 202 Accepted for update and delete requests (ENT-4803) - Deleted __LastSeenHostsLogs internal table and references (ENT-5052) - Added usernames to apache access logs (ENT-5138) - Reworked status table renaming to be more effective (ENT-4968) - Added 10 minutes threshold to "Agent not run recently" health diagnostics category to avoid showing false positive warnings in case of manual cf-agent execution (ENT-4228) - File changed alerts condition was added (ENT-4811) - File changes statistics API was added (ENT-4727) - File changes widget was added (ENT-4731) - New indexes were added to __promiselog and __promiseexecutions tables - Only read operations are now allowed via the query API (ENT-4938) - Optimized Query API by adding limit directly to a user query (ENT-4903) - Replaced promise_outcome type with character varying on __PromiseExecutions table to speed up select queries from PromiseExecutions view. Otherwise will be used sequence scan instead of index scan (ENT-4825) - View to select not kept not repaired hosts was added (ENT-4862) - Widget to show the total number of promises not kept and not repaired was added (ENT-4767) - `Promises not kept (failed) that have not been kept or repaired` report was added (ENT-4766) - Partitioned __inventory table for federated reporting (ENT-4842) - Fixed Event log date range filter default values Now correctly shows current date, instead of 1 week in the past. (ENT-5072) - Fixed email notification link to pause, edit or remove alerts (ENT-4249) - Fixed file changes PDF report. Used " escape parameter instead of default / while CSV data parsing. Otherwise extra columns will be added. (ENT-4989) - Fixed help indicator UI bug (ENT-4819) - Fixed license owner to not show html characters (ENT-5024) - Fixed missing public namespace for some PL/pgSQL functions (ENT-5040) - Fixed incorrect Hub management UI "flashing" before being replaced by javascript (ENT-4787) - Fixed `matches` inventory filter condition when list had only 1 item (ENT-5151) - Fixed global search result active app. Change active application to hosts in case of global search result (ENT-4818) - Fixed number of remaining days on license in header (ENT-4941) - Fixed memory leak in windows version of glob matching (ENT-4895) - Fixed small memory leak in cf-serverd, when packing enterprise reporting data (ENT-4895) - Fixed potential memory leaks in nova API (ENT-4895) Packaging changes: - Added ON_ERROR_STOP=1 to psql commands to make postinstall easier to debug (ENT-5035) - Built packages now include mdb_load and mdb_copy lmdb utilities (CFE-3133) - Added proper release number to BFF (ENT-4691) - Addressed CVE-2019-1552 on Windows (ENT-4901) - Publish tarball with a filesystem image and accompanying files for CoreOS (ENT-4758) - Enabled zlib extension in PHP to support png images with alpha channel (ENT-2828) - Fixed OOTB https redirection when hostname contains uppercase letters (ENT-4821) - Wait for postgresql to be available before rotating keys (ENT-4853) - 'systemctl enable' failure no longer stops the postinstall package scripts (ENT-5188) - Added build number to CoreOS and generic tarballs (ENT-4981) - Added explicit build numbers to Windows, Solaris and HP-UX builds (INF-1253) - state/pg directory permissions are now updated on on every upgrade (ENT-5063) - Got rid of git commands and other DC legacy in postinstall script (ENT-4904) - Fixed SQL schema error during upgrade (ENT-4835) - Updated lmdb from 0.9.23 to 0.9.24 - Updated openssl from 1.1.1b to 1.1.1d - Updated openldap from 2.4.47 to 2.4.48 - Updated apache from 2.4.39 to 2.4.41 - Updated git from 2.21.0 to 2.24.0 - Updated postgresql from 11.3 to 12.1 - Updated php from 7.3.5 to 7.4.0 - Updated libcurl from 7.64.1 to 7.67.0 3.14.0: - Added Federated Reporting APIs (ENT-4379) - Added Health diagnostic API (ENT-4444) - Added SQL queries to change saved reports (ENT-4093) - Added data transfer module that allows to transfer Mission portal data between hubs (ENT-4126) - Added decommissioned hosts widget to dashboard (ENT-4603) - Added hostname to host page header (ENT-4620) - Added log messages to the Policy analyser summary table (ENT-4323) - Added missing slash in async query result URL (ENT-4553) - Added new `is` match condition to software update alerts (ENT-569) - Added new widgets to default dashboard after upgrade (ENT-4301) - Added newline to API error responses (ENT-4747) - Added not kept badge count to Policy analyzer app (ENT-4275) - Added possibility to dismiss hosts from Health diagnostic reports (ENT-3950) - Added web role-based access control and RBAC API (ENT-4139) - Aligned host info and default saved reports for software updates available (ENT-4726) - Aligned host info software report columns with stock software report (ENT-4726) - Inventory API now allows multiple values for one filter (ENT-4371) - Made permissions of CFE_ROBOT user more strict (ENT-4513) - Changed clear_hosts_references to delete lastseenhosts based on hostkey - Changed columns type from integer to biginteger for existing tables (ENT-4350) - Changed hosts include/exclude requests to POST (ENT-4636) - Changed m_host to vm_hosts in API to avoid querying to the protected materialized view - Changed m_inventory into a regular table (ENT-4554) - Changed policy analyzer hosts source from vm_hosts to hosts (ENT-4740) - Changed trigger on insert into __hosts from EACH STATEMENT to EACH ROW (ENT-4662) - Changed trigger to refresh m_hosts from EACH ROW to EACH STATEMENT (ENT-4443) - Check processFilters function argument (ENT-4634) - Clarified error message when report collection data is invalid (ENT-4495) - Deny using materialized view over QUERY API (ENT-4477) - Disable database triggers in the data generator (ENT-4662) - Discover new hosts for report collection every minute (ENT-3844) - Do not generate rbac_role_permission for cf_remoteagent role (ENT-4139) - Do not wrap hostname in anchor HTML tag (ENT-4216) - Expanded remote hub API with statistics data (ENT-4771) - Extended status API to return hub info (ENT-4567) - Fixed Host API deletion status codes (ENT-4265) - Fixed detection of recent Windows versions (ENT-3363) - Fixed edit sub-category dialog title (ENT-791) - Fixed empty 'Hosts never collected from' health diagnostic report (ENT-4696) - Fixed errors in cf-serverd when loading old JSON promise log (ENT-4555) - Fixed hanging reports with no errors in logs (ENT-4397) - Fixed host tree loading issue (ENT-4214) - Fixed host tree to show hosts when the uncategorized view is selected (ENT-4461) - Fixed JS error on scheduled reports (ENT-4638) - Fixed JSON content in the policy analyzer editor (ENT-4279) - Fixed Policy analyzer filter by directory/file (ENT-4405) - Fixed REST API basic authentication (ENT-4349) - Fixed broken ootb_import.sql (ENT-4303) - Fixed date extraction from table name in promise_log_partition_cleanup postgresql function (ENT-4588) - Fixed duplicate key value violates unique constraint variables_dictionary_attribute_name (ENT-4342) - Fixed inventory API limit in case of NULL value (ENT-4585) - Fixed inventory widget empty and duplicate values (ENT-4464) - Fixed license expiration in Mission Portal (ENT-4385) - Fixed wrong file owner of generated scheduled reports (ENT-4600) - Fixed 2 small memory leaks in enterprise agent (ENT-4313) - Fixed a segmentation fault in parsing of reporting data If csv files in /var/cfengine/state/ (generated by agent runs) were corrupted, cf-serverd would crash while reading them. (ENT-4505) - Fixed an issue with error handling in cf-hub delta queries cf-hub will now attempt a rebase if it cannot obtain the last report timestamp. This change only affects scheduled runs, not when invoked with `--query delta` from command line. This also means that hosts which are not present in status table will be rebased (not delta from 0). (ENT-4319) - Fixed an issue with manual cf-hub delta queries When invoked manually (cf-hub --query delta) it would request the wrong starting timestamp from client, causing patch failures. (ENT-4120) - Fixed edge case memory leak in enterprise agent/server (ENT-4313) - Fixed memory leaks in cf-hub (ENT-4313) - Fixed small memory leak in enterprise hub / agent (ENT-4313) - Fixed small memory leak when using HA (ENT-4586) - Fixed JS Errors in policy analyzer app (ENT-4799) - Implemented web role-based access control (ENT-4139) - Improved readability of reporting information on host info page (ENT-4531) - Made it possible to edit software available and installed reports and add new filters to them (ENT-4278) - Moved Health diagnostics from Mission portal to API (ENT-4444) - Prevented segmentation fault in enterprise API when LicenseInfo is empty (ENT-4376) - Relaced refresh materialized inventory view function by update_inventory (ENT-4554) - Removed xss_clean validation rule from LDAP settings form because it prevents saving specific characters (ENT-4654) - Renamed "IP Naming" to "Report Collection" (ENT-4471) - Renamed the "Status" table to "__Status" with RBAC-checked view (ENT-4331) - Renamed Host count widget to Newly bootstrapped hosts (ENT-4649) - Simplified error handling and error messages for failed report collection (ENT-4495) - Switched perms of various temporary files in state to 0600 These files were created with 0644 permissions, and then repaired in policy. However, since they are deleted / recreated periodically, it causes INFO noise. Safer and better user experience to create them with restricted permissions to begin with. Affected files: * `$(sys.statedir)/context.cache.tmp` * `$(sys.statedir)/variable.cache.tmp` * `$(sys.statedir)/diff/*.diff` * `$(sys.statedir)/previous_state/*.cache` (ENT-4601) - Updated links to postgresql docs to match running version (ENT-4436) - Updated role database entry on POST requests instead of deletion and creation This change was made to avoid deleting related to role entries because previously while role updating the database entry is deleted and recreated. (ENT-4483) - HTTPS protocol is now used in CLI commands (ENT-4361) - Fixed license count for hosts with duplicate entries in lastseen DB (ENT-4595) - Variable values can no longer be NULL in reporting The reporting system doesn't distinguish between NULL and empty string. Previously, variables with value "" would show up in psql as NULL. This can be cumbersome when writing queries, and doesn't accurately reflect the variable value in policy. NULLs are now converted to empty string before insert. This change only affects 2 tables in postgresql: "variables" and "variableslog". This change can trigger a rebase if you already have reporting data with variablevalue=NULL. (ENT-4093) - cf-hub now validates that variable types are within range (ENT-4507) Packaging changes: - Added ubuntu 18 to the list of build platforms (ENT-4041) - Clean php extensions directory before install (ENT-2614) - Disable phar read only (ENT-4126) - Do not check for absence of postgresql directory before migration (ENT-4557) - Fixed patterns not to include square brackets (ENT-4515) - Fixed running cfengine3 init script in AIX RPMs (ENT-4305) - Rewrote PostgreSQL migration (ENT-4353) - Set -e in package scriptlets (ENT-3385) - Set explicit permissions on the install log file (ENT-4506) - Updated dependency table (ENT-4227) - Password operations are now hidden from the install log (ENT-4512) - Internal keys are now rotated on every upgrade (ENT-4515) - Updated lcov from 1.13 to 1.14 - Updated lmdb from 0.9.22 to 0.9.23 - Updated pcre from 8.42 to 8.43 - Updated sasl2 from 2.1.26 to 2.1.27 - Updated libiconv from 1.15 to 1.16 - Updated libxml2 from 2.9.8 to 2.9.9 - Updated libyaml from 0.2.1 to 0.2.2 - Updated openldap from 2.4.46 to 2.4.47 - Updated libcurl-hub from 7.61.1 to 7.64.1 - Updated apr from 1.6.5 to 1.7.0 - Updated apache from 2.4.35 to 2.4.39 - Updated postgresql-hub from 11.0 to 11.3 - Updated php from 7.2.11 to 7.3.5 - Updated libcurl from 7.61.1 to 7.64.1 - Updated OpenSSL from 1.1.1 to 1.1.1b - Updated git from 2.19.1 to 2.21.0 - Upgraded CodeIgniter from 3.1.3 to 3.1.10 (ENT-4486) 3.13.0: - Make class inventory available via inventory API (ENT-3885) - Add custom SQL condition info to the Help page. (ENT-3821) - Add line number to the promise execution log (ENT-3925) - Add the policy file hash to the promise execution log (ENT-3996) - Added an error summary when running cf-hub --query - Allow to deselect default role. (ENT-3854) - Change default limit of inventory widgets. (ENT-3875) - Change design center data processing. (ENT-3818) - Change/policy url format was changed (ENT-3895) - Changed exit codes of cf-hub to be much more useful In short, when using --query, exit code will be number of failed host report collections, up to 100. 101+ are reserved for specific error conditions. See documentation for full details. Ticket: (ENT-3829) - Fixed issue when Changes report sometimes was shown empty. (ENT-3894) - Clean up grammar in bootstrap tour (ENT-3912) - Clear hosts references in case of host was deleted. (ENT-3902) - Group hosts without category into a "hosts without category" category in a hosts tree (ENT-3877) - Export with several order by expressions was fixed. (ENT-3943) - Fix array encoding in Pest methods. (ENT-3818) - Fix different order in exported reports. (ENT-3982) - Fix error message on host tree when a user does not have any role. (ENT-3901) - Fix inventory filter value cannot be changed after clicking close button. (ENT-3919) - Fix waiting for element in selenium CustomAlertCondtionTest (ENT-3874) - Fix wrong hosts are using the same identity diagnostic reports. (ENT-3876) - Handle unauthorized XHR requests. (ENT-3992) - Hide edit user possibility for external users. (ENT-3940) - Link to host page was added in Inventory report. (ENT-516) - Method to define the default inventory filter condition was fixed. (ENT-3911) - New type of report was added to identify hosts likely using same identity. (ENT-3550) - Parsing of Changes/policy exclude and include parameters were changed. (ENT-3895) - Pause/Resume tour guide possibility was added (ENT-3867) - Refresh materialized view in case of a host was bootstrapped. (ENT-3748) - Remove wrong code that produces warnings from cli_tasks. (ENT-3928) - Removing a user confirmation text was changed. (ENT-3643) - Report Hosts never collected from was added to health diagnostics (ENT-3551) - Report Hosts never collected from was added to health diagnostics (ENT-3551) - Report Several hosts likely using same identity (ENT-3550) - Fix issue with exporting big (2-5M records) reports by running export by parts (ENT-3870) - Set sendmail protocol selected by default. (ENT-3815) - Show apply, cancel, clear buttons on reports with filter. (ENT-3881) - Show ldap users into internal users tab. (ENT-3909) - Show license reminder when licenseGranted more than 25. (ENT-3653) - Silenced error about row number in error_log (ENT-3565) - The SQL query to get hosts information was fixed. (ENT-3900) - Tour guide about what's new in Mission Portal (ENT-3853) - Validation improvements on LDAP settings. (ENT-3816) - adjust enterprise code for atexit to cleanup refactoring (ENT-3756) - fix host count group by in Firefox (ENT-3893) - refine data_generator documentation (ENT-3887) Packaging changes: - Make runalerts.php executable. (ENT-3921) - Move old shared/GUI files aside during upgrade (ENT-3898) - Set right owner and permissions to httpd/htdocs. (ENT-3906) - Treat php.ini as a config file by pacakge (ENT-3835) - Update PHP from 7.2.6 to 7.2.11 - Upgrade PostgreSQL from 10.4 to 11.0 - Update git from 2.17.0 to 2.19.1 - Update Apache from 2.4.33 to 2.4.35 - Update APR from 1.6.3 to 1.6.5 - Upgrade CURL from 7.59.0 to 7.61.0 - Upgrade libacl from 2.2.52 to 2.2.53 - Update libattr from 2.4.47 to 2.4.48 - Upgrade YAML from 0.1.7 to 0.2.1 - Upgrade OpenSSL to 1.1.1 3.12.0: - Get cmdline info about all processes at once on windows (ENT-2536) - Redis database and cf-consumer are no longer used All reports are applied to postgres from cf-hub worker threads. Logging and measurements have been updated to reflect this change. Reporting statuses (success, failure, rebase, retry) are no longer duplicated in these two databases. All statuses are stored and read from postgres The diagnostics measurement redis_processing_time_per_host has been replaced by hub_processing_time_per_host, tracking the time hub uses to apply reports to postgres (excluding time spent collecting report from client) (ENT-2814) - Added ability to exclude specific hosts from dashboard alert conditions (ENT-3491) - Added the option to skip mailing scheduled reports if 0 records added (ENT-3584) - System V init now notifies when it skips managing postgres because of HA (ENT-3657) - Inventory charts were added to dashboard (ENT-3234) - Custom SQL-based condition type was added (ENT-3553) - Remove old LDAP implementation /api/settings only supports ldapHost(ldapApiUrl) and ldapEnabled(ldap or internal) now. All other settings are managed with /ldap/settings API. (ENT-3247) - Mail settings were added into Settings and Welcome tour parts - Warn when attempting to delete missing *.diff file during serving rebase query by cf-serverd (ENT-3261) - Ensure that runalerts.php is shutdown when using sysvinit (ENT-3310) - Categorization view sharing in the hosts app fixed (ENT-3110) - Add default alert for failed policy deployment (ENT-3436) - Increase auto-increment limits for __PromiseLog, __MonitoringMgMeta, __MonitoringYrMeta tables (ENT-3404) - Add b-tree index for variable value - improving inventory and variable table equality and 'like' lookup performance (ENT-3393) - Improve loading of monitoring app (ENT-3232) - Reordered --help output and fixed smaller inconsistencies (ENT-3562) - Validate Class Regex properly in Mission Portal Hosts tree (ENT-3340) - Increase password limit to 100 characters (ENT-2767) - Sync masterfiles-stage with core-contrib (ENT-3434) - Remove extra column "host key" in report export (ENT-3102) - Inventory Policy Release ID by default (CFE-2097) - Fixed lastseen interval values in LastSeenHosts report (ENT-3320) - Include Agent Execution Status report in rebase query replies (ENT-3246) - Disable Design Center by default (ENT-3462) - Added inventory API - Speed up host tree loading (ENT-3474) - Include time to pack reports in benchmarks (ENT-3323) - Fix multiple users to subscribing to same report - Added Event API - Ignore non numeric values in free disk space report (ENT-3305) - Added Host count API and trend widget for dashboard (ENT-3484) - Inventory UI now uses inventory API (ENT-2801) - Increased cf-hub network timeout from 10 to 30 seconds (ENT-3153) - Changed exit codes of cf-hub to be much more useful In short, when using --query, exit code will be number of failed host report collections, up to 100. 101+ are reserved for specific error conditions. (ENT-3829) - Added an error summary when running cf-hub --query - Remove count of updates installed from host info page Updates installed are only available for some platforms and only from the legacy package promise implementation. It is being removed to avoid making users think no patches are installed when the platform doesn't differentiate patch installs from base packages (ENT-3401) - Query API response now properly informs of invalid requests (ENT-3226) - New type of report was added to identify hosts likely using same identity (ENT-3550) - Report Hosts never collected from was added to health diagnostics (ENT-3551) - Windows 10 OS is now correctly detected for platform classes (ENT-3363) Packaging changes: - Optimise Windows version generation - Use share/GUI as template when purging httpd/htdocs dir (ENT-3217) - Removed obsolete options from PostgreSQL config (ENT-3656) - Added cf_net.exe to msi packaging - Remove package installation of cf-twin (CFE-2029) - Remove unused sysconfig variable RUN_CF_HUB (CFE-2739) - Run ldap migration script in postinstall.sh (ENT-3284) - Ensure Enterprise Hub package upgrade aborts when backup fails (ENT-3336) - Enable LDAP support in PHP (ENT-3373) - Run ldap post-install.sh after installation (ENT-3382) - Set default memory_limit for php to 256M (ENT-3391) - Upgrade using pg_upgrade instead of dump/restore (ENT-3398) - Remove libphp5.so (ENT-3520) - Remove libmcrypt dependency - Update PCRE from 8.40 to 8.42 - Update rsync from 3.1.2 to 3.1.3 - Update PostgreSQL from 9.6.2 to 10.4 - Update git from 2.13.0 to 2.17.1 - Update LMDB from 0.9.19 to 0.9.22 - Update libxml2 from 2.9.4 to 2.9.8 - Update PHP from 5.6.30 to 7.2.6 - Update OpenSSL from 1.0.2k to 1.1.0h - Update CURL from 7.54.0 to 7.60.0 - Update OpenLDAP from 2.4.44 to 2.4.46 - Update Apache from 2.4.25 to 2.4.33 - Update APR from 1.5.2 to 1.6.3 - Update APR-util from 1.5.4 to 1.6.1 3.11.0: - Optimize Query API by removing subsequent count query for pagination (ENT-2829) - cf-monitord: fix custom measurements of type counter - Fix saved report access by roles (ENT-3099) - Add button for copy host link (ENT-3096) - Logs from mission portal moved outside webroot folder (ENT-2758) - Maintain sorting of columns in export inventory report (ENT-614) - Can't export csv fix (ENT-3092) - Make host links clickable (ENT-3094) - Show changes reports for “today” by default (ENT-2840) - Add global host search (ENT-3059) - Add CoreOS to the default hosts tree (ENT-3135) - Fix bogus error messages output from cf-monitord with custom measurements promises (ENT-2595) - Add possibility to save username with dots - Fix disapearing hosts after upgrade (ENT-3112) - Enforce license expiry correctly (remove extra month) (ENT-2261) - Fix file descriptor leak in hub's cf-serverd with call-collected clients (ENT-3088) - Stop service cfengine3 status from warning on multiple httpd processes (ENT-3123) - Monitoring app in Mission Portal never loads (ENT-3232) - BugFix: allow multiple users to subscribe to same report - Categorization view sharing in the hosts app fixed (ENT-3110) - Warn when attempting to delete missing *.diff file during serving rebase query by cf-serverd (ENT-3261) - Clear inventory lists from braces and quotes (ENT-154) Packaging changes: - Create a tar.gz binary package for CoreOS or other systems - Fix: Mission Portal availability on install without running policy (ENT-3035) - Fix inability to correctly manage cf-postgres service after upgrade (CFE-2545) - Relocate Mission Portal application logs Mission Portals application logs have moved from /var/cfengine/httpd/htdocs/application/logs to /var/cfengine/httpd/logs/application (ENT-2758) - Set default timezone for php to UTC (ENT-3131) - Update autoconf from 2.60 to 2.69 - Update curl from 7.50.3 to 7.53.1 - Update libiconv from 1.14 to 1.15 - Upgrade to LMDB 0.9.19 - Remove postgresql dependency on agents in our binary packages (ENT-3164) - Update libcurl to 7.54.1 - Remove libvirt dependency from our binary packages (ENT-3164) - Update lcov from 1.10 to 1.13 - Update PCRE from 8.39 to 8.41 - Update Apache from 2.4.25 to 2.4.27 - Update Redis from 3.2.6 to 3.2.9 - Update PostgreSQL from 9.6.1 to 9.6.3 - Update PHP from 5.6.29 to 5.6.31 - Upgrade openldap from 2.4.44 to 2.4.45 - Update Git from 2.10.2 to 2.13.3 3.10.0: - Upgrade CFEngine dependencies to the following versions: - PostgreSQL 9.6.0 - Redis 3.2.4 - PHP 5.6.26 - Git 2.10.1 - Add: Inventory for system product name (model) (ENT-2780) - Change: Disable TCP and redis (ENT-2761) - Change: Rename duplicate bodies in ha_update.cf (ENT-2753) - Add: Ensure appropriate permissions for SSL files (ENT-760) - Fix cf-serverd being launched under wrong account on Windows. (ENT-2755) - Enterprise: Fix Postgres database migration from 3.8- to 3.9+. (ENT-2760) - Hub package no longer depends on libltdl. (ENT-2714) - Add: Enterprise appliaction log dir to rotation - Change: Session Cookies use HTTPOnly and secure attribtues (ENT-2781) - Change: re-enable hub process maintainance - Change: Disable RC4 Cipher for ssl in Mission Portal - Change: Reduce php info leak - Change: Reduce Enteprise webserver info - Fix errors of type "No file object exsists in path" on Windows. - Canonify class names stored in class history log. (ENT-2821) - Change: Disable autocomplete for login - Fix a bug which incorrectly detected PostgreSQL running status when running "/etc/init.d/cfengine3 status". - Optimize Query API by removing subsequent count query for pagination. (ENT-2829) 3.9.0: - Change: Render Mission Portal httpd.conf with mustache (Jira ENT-2568) - Change: Switch to http redirect by default (Jira ENT-2071) - Fix exporting CSV reports through HTTPS. (Redmine #7267) - Add: Bundle to generate a self signed cert for Mission Portal - For call collect in Enterprise, default collect_window setting increased from 10 to 30 seconds for reliability reasons in large-scale environments. - Upgrade CFEngine dependencies to the following versions: - Apache 2.4.20 - Git 2.8.3 - PHP 5.6.22 - PostgreSQL 9.5.3 - Redis 3.0.7 - rsync 3.1.2 (Jira ENT-2720) - Fix scheduled report not beeing emailed when report type is set to only contain CSV file type. (Redmine #3780, #7619) - Introduce class json log. (Redmine #7951) - Introduce new promise log logging. (Redmine #7887) - Fix broken call collect. (Redmine #7701) - Fix error logging to MP via HTTPS. (Redmine #7687) 3.8.2: No Enterprise specific fixes for 3.8.2, see Community changelog. 3.8.1: Changes: - Upgrade CFEngine Enterprise dependencies to the following versions: - OpenSSL 1.0.2e - PCRE 8.38 - libxml2 2.9.3 - OpenLDAP 2.4.43 - Redis 3.0.6 - PHP 5.6.17 - libcurl 7.46.0 - Git 2.6.5 3.8.0: Changes: - Move hub_log from /var/cfengine to /var/cfengine/log. - Change in behaviour: when running "cf-hub -q -H" manual report collection, policy is parsed before collecting, so there must be valid policy in inputs directory. (Redmine #7542) - Introduce by field truncation for promise execution entries. (Redmine #7466) - Move promise_summary.log into /var/cfengine/log directory. Bug fixes: - CFEngine on Windows no longer truncates log messages if the program in question is killed halfway through. - For call collect in Enterprise, default collect_window setting increased from 10 to 30 seconds for reliability reasons in large-scale environments. - Fix package not installing on Windows 2008 32-bit. (Redmine #7478) - Fix not being able to delete log files while CFEngine is running on Windows. (Redmine #7149) - Fix: Typo in cf-hub error message - Fix resource restrictions of SQL API matching table names as substrings. (Redmine #7536) - Removed error message from cf-serverd when not finding software inventory. E.g. "Failed to access current state for report: 'software'". - Fix last agent run timestamp in Agents not reporting (health bar). (Redmine #7406) 3.7.2: Bug fixes: - For call collect in Enterprise, default collect_window setting increased from 10 to 30 seconds for reliability reasons in large-scale environments. - CFEngine on Windows no longer truncates log messages if the program in question is killed halfway through. - Fix: Typo in cf-hub error message - Removed error message from cf-serverd when not finding software inventory. E.g. "Failed to access current state for report: 'software'". 3.7.1: Behavior changes: - Change in behaviour: when running "cf-hub -q -H" manual report collection, policy is parsed before collecting, so there must be valid policy in inputs directory. (Redmine #7542) Bug fixes: - Fix resource restrictions of SQL API matching table names as substrings. (Redmine #7536) - Add truncation for promise attribute sizes to prevent from ignoring to long reports. (Redmine: #7466) - Fix last agent run timestamp in Agents not reporting (health bar). (Redmine #7406) - Fix noise from internal policy to upgrade windows agents (Redmine #7456) - Fix package not installing on Windows 2008 32-bit. (Redmine #7478) 3.7.0: Mission Portal: - Multiple dashboards - Dashboard sharing - 'Changes' report type added - 'Changes' widget introduced - Added more out-of-the-box inventory variables Bug fixes: - Fix for health status in header occasionally not loading - Fixed icons disappearing from host categorization dropdown after editing - Process matching on Windows has been rewritten, which should make process promises work more reliable there. (Redmine #6977) - Failure in output log cleanup on Windows has been fixed. (Redmine #7149) API: - Introduce Changes API - Remove PromiseExecutionsLog (replaced with Changes API) - Remove SoftwareUpdatesLog 3.6.6: Bug fixes: - Ignore empty log messages while logging promise executions in cf-agent evaluation. - Fix Postgres CPU usage spikes. - Fix upgrate for monitoring. - Fix duplicate key value violates unique constraint "status_pkey" error. - Reduce database size in high load hub by making vacuum strategy more aggressive. 3.6.5: Bug fixes: - Fix cleaning-up monitoring during upgrade. - Remove unused bundles.lmdb to reduce agent I/O usage. - Redesign classes and variables storage (for reporting) to reduce I/O usage. - Improve API performance for DELETE requests on /api/host/:id resources. Mission Portal: - Small CSS changes - Widgets & alerts view - UI changes - Updated links to support portal 3.6.4: Bug fixes: - Fix "cfe_autorun_inventory_dmidecode" error message on Windows if Powershell is not installed. - Fix bogus failed promise, "cfe_internal...", as a result of indexing packages for the inventory screen. (Redmine #6865) Mission Portal: - LDAP settings UI improvements - Unsaved SQL and Inventory Reports are preserved while refreshing/navigating in browser browser - Help text: Added instructions to turn on Monitoring data - Health bar dropdown labels and reports renamed Changes: - Introduce automatic rebase for the client if the client have not been successfully collected for defined period of time. Timeout is set by client_history_timeout attibute in hub body and if it is not set, it defaults to 6 hours. Note: During rebase all accumulated reports up till that event are ignored and not collected by the cf-hub. 3.6.3: Mission Portal: - Added license information to header - General UI cleanups and small bug fixes - Optimization of Software Updates alert - Inventory reports: - Made software filtering case insensitive - Updated help text - Performance improvements - Alerts: - Bug fix for duplicate alerts in overview - Bug fixes for deleting alerts & widgets - Settings: - LDAP search filter help text & validation 3.6.2: Changes: - Monitoring magnified and monitoring yearly database schema have been redesigned to reduce database disk space usage over time. - RBAC backend have been redesigned from dynamically generated tmp views to static global views that use session variables for passing context filters and host identifier. Filtering also switched from dynamically generated queries to Full Text Search. Mission Portal: - UI changes: redesigned alerts + conditions overview screen - Layout improvement of alert results view - Added navigation menu buttons to dashboard + alerts screens - High Availability status added to header bar - Custom notification script UI added to settings and alert editing - Added 'Low disk space' alert + 'System health' widget OOTB - Bug fixing/small UI improvements 3.6.1: Changes: - 'cf-key --install-license' installs hub-specific license key file "fqname-hostkey.dat" in $WORKDIR/licenses, where they can easily be managed centrally via a VCS - hub-specific license file is searched in $WORKDIR/licenses before license.dat is searched in $WORKDIR, $WORKDIR/inputs and $WORKDIR/masterfiles - Where appropriate, Enterprise API returns proper NULL json objects rather than literal "NULL" values Mission Portal: - streamlined UI for inventory reporting - fix username/role lookup failures if external authentication backend is case insensitive - reduce number of LDAP roundtrips - allow filtering of reports by category - allow reordering of widgets on dashboard - UI for bulk-deleting decommissioned hosts from "health" menu - various behind-the-scene fixes and improvements to speed up UI and reporting Platform support: - Introduced Windows support into the CFEngine 3.6 series. 3.6.0: Mission Portal: - UI and layout improvements and cleanups - Dashboard and alerts introduced - Inventory report type and view introduced - Report categories introduced - CFEngine health indicator added to UI with links to associated reports - Host number indicator added to UI - Inline help and help pop-ups added for new features - Welcome tour pop-up introduced - Host filter UI improvements - search host name, select/deselect all - About CFEngine page - license and version information has moved to a dedicated page in settings - Fixes for IE8 compatibility - Added option in UI to allow logging in to Mission Portal over https - Design Center sketch catalog redesign - sketches can now be filtered by category, tag, or search - UI to reset git settings in Design Center Hub: - Remove --cache / -a command line option from cf-hub binary - Remove --index / -i command line option from cf-hub binary - Remove --maintain / -m command line option from cf-hub binary (Maintenance process have been implemented in the policy) - Remove MongoDB Diagnostics - Promise repaired/notkept log have been removed from report collection. It have been replaced by promise executions report. - Total compliance report have been removed from report collection. - Setuid report have been removed. - Promise definitions report have been removed. - Promise and bundle compliance reports have been removed. Their functionality have been replaced with promise executions report. - Reporting database and report collection architecture have been redesigned to improve performance and scalability characteristics. - MongoDB reporting database have been replaced with PostgreSQL 9.3 - Context, Variable, Software Installed, Software Patches and Promise Execution reports support history over time. History length is controlled per report type and can be configured in cfe_internal_hub_maintain bundle. - Introduce new hub query type: 'rebase' ('full' query aliases 'rebase') for re-downloading full state of the client in current moment. Rebase query result overwrites all non-historical entries about the host in the database. - Include meta data contents to contexts and variables reports. Enterprise Rest API: - Rest interface for Design center - Additional information returned for host (lastreport and firstseen) - Rest API 2.2 (/rest API) have been removed. - Enterprise API performance have been improved. - SQL API table schema have been redesigned. - Remove API cache. - Pagination and sorting improvements. - Introduce 'hostIdentifier' setting to /api/settings. - Fixes in LDAP support. - Delete host API now additionally removes host from lastseen database as also removes host public key. Bug fixes: - Removed MongoDB - cf-serverd for Windows now binds to both IPv4 and IPv6 by default, not just IPv6. (Redmine #3980) - cf-agent now reports host packages installed and available by default. (Redmine #3257) - Fixed incorrect file diff generation when a line had moved within a file, and certain other corner cases. (Redmine #5015) - Windows fixes: - CFEngine now handles Windows newlines correctly within text files when editing or using the module protocol. Existing text files will keep their newline type (either LF or CRLF), whereas new files will get CRLF newlines. (Redmine #4733) - CFEngine will no longer display a blocking popup if it crashes. - CFEngine now reports uptime correctly on Windows. Enterprise extensions: - Remove promise_notkept_log_include, promise_notkept_log_exclude, promise_repaired_log_include, promise_repaired_log_exclude (syntax is valid but not functional) - Remove classes_include, classes_exclude, variables_include, variables_exclude (syntax is valid but not functional) - Introduce promise_handle_include, promise_handle_exclude attributes from report_data_select - Introduce metatags_include, metatags_exclude attributes from report_data_select - Deprecate export_zenoss attribute - Introduce promise_execution.log containing outcome and information about all executed promises. It can be found under cfengine/state/ data format is CSV. - Agent execution time have been included into benchmarks report. - After disabling report_data_select filtering rule, include last known value in next packaged report. 3.5.3: Bug fixes: - purge old data for promises with long promise handles (Redmine #3438) - fix constraint violation in PromiseDefinitions table which resulted in error everytime this table was loaded (Redmine #3370) - enable update of promise definitions database from policy - fix cfengine3 init.d script to correctly detect debian systems with yum installed (Redmine #3589) Mission Portal: - various layout and UI fixes - fix editing of event trackers - speed up listing of hosts for promises not kept - maintain host context (Redmine #3474) - ability to manually add context filter in the SQL app (Redmine #3466) - host identifier settings simplified (Redmine #3101) Packaging fixes: - Correct php.ini path in the packaged httpd (Redmine #3445) - Add missing mongodb tools in ubuntu/debian hub packages (Redmine #3444) - Fix manpath error for SLES (Redmine #3539) - Fix file permissions - some policy files had executable bit set (Redmine #3521) 3.5.2: Changes: - MongoDB has been upgraded to version 2.2.4 - monitoring data has moved into a separate database See db-move-monitoring-to-cfmonitor.js script to migrate data Bug Fixes: - Fix segfault of cf-serverd on HP-UX - Do not to start a mongodb repair unnecessarily - cf-hub -H now supports multiple hosts Mission Portal: - Reports can be published and shared between users - Various UI improvements - Optimizations in the report engine 3.5.1: Mission Portal: - SQL queries can be shared between users - Fix timing issues for downloading large SQL reports - Purge sketch data when no longer used by active sketches - Uninstall sketches that have no activation - Support for boolean, menu option and optional parameters in Design Center UI - UI fixes to user and role management pages - Delete navigation tree definitions of deleted uses - Fixes to password reset - General UI improvments - Fixes for IE8 compatibility Changes: - Perform a database repair from init script if unclean shutdown of mongod is detected - Redmine #3035 - Data collection and cf-hub - Improved database connection handling during report collection by cf-hub. - REST APIs support an optional disableCache flag; when set, the backend always hits the MongoDB - Redmine #2945 Bug Fixes: - don't generate ERR message during maintenance if environments couldn't be queried, changed to INFO message - Fix usemodule on Windows (Redmine #1884) - Fixed replica set detection (regression in 3.5) - Redmine #2806 - Set correct precision format when storing db diagnostics to avoid null-values - Fix possible division-by-zero bug in compliance meters (Redmine #2734) 3.5.0: New features: - Mission Portal - added Design Center UI to simplify sketch activation, including MP specific git settings to support version control of sketch configurations - re-focused apps support quick navigation - added persisting host and policy context between apps - extended the SQL builder interface with more tables - Added FirstReportTimeStamp into Hosts table in SQL REST API. This time value represent fist report time after bootstrap, already bootstrapped agents will set this with first report after update. - Added regular expression support to SQL queries - HostContext filter support in SQL REST API. - added global navigation trees which are only editable by admins, including the option to share trees with other users - REST API extensions - New optional parameters for REST API were added: hostContextInclude and hostContextExclude (array type) - PromiseContext filter support in SQL REST API. - New optional parameter for REST API was added: promiseContext (input: all / user / system) - Data collection and cf-hub - Added set and clear triggers for persistently disabling CFEngine components. eg. to disable cf-monitord, run cf-agent with "-Dset_persistent_disable_cf_monitord" to re-enable use: "-Dclear_persistent_disable_cf_monitord" - Host side report content filter for class, variable, promise log and monitoring reports. Controlled by report_data_select body in access promise. - Diagnostics logging and SQL REST API for MongoDB, report collection and maintenance process on the enterprise hub. - Windows - Windows Powershell support. execresult(), returnszero() and commands promises now supports "powershell" as an option in addition to the "noshell" and "useshell" variants. "powershell" is also added as a hard class in order to test whether Powershell is available. Changes: - Mission Portal - new visual design - streamlined interactions for building new trees - trees are now loaded lazily - general clean-up to the tree controls - hosts in trees are no longer color coded - hosts are only classified as red, green or missing data - operating system tree is now loaded by default - SQL queries are now run by default after clicking their respective links, running a query is now primary action in the UI (#2393) - data and result sets can now by filtered based on navi-tree - logged-in user's name is visible again in the toolbar - removed beta apps - Windows - Improved ACL handling on Windows, which led to some syntax changes. We now consistently use the term "default" to describe ACLs that can be inherited by child objects. These keywords have received new names: acl_directory_inherit -> acl_default specify_inherit_aces -> specify_default_aces The old keywords are deprecated, but still valid. In addition, a new keyword "acl_inherit" controls inheritance behavior on Windows. This feature does not exist on Unix platforms. - Enterprise API - Export SQL results to sqlite3 database file - Data Collection and cf-hub - cf-hub has got an option -q to query reports from the running agent. This option used to reside in cf-runagent, and has been moved to cf-hub. - Full and delta reports send only mon and sys variables as also hosts excluding policy server are reporting only subset of monitoring data. This can be changed using access promise in default cf_serverd.cf policy. - Removed license checking on hosts. Bugfixes: - Mission Portal - promise finder now does string matching - assigning roles in user management now makes sense - report builder now has a "new query" button - blue hosts' lacking data history is indicated correctly now - CSS fixes - finders no longer load duplicate list items - Fix inconsistent behavior of black host status directly after install. - Enterprise API - Fix some REST queries not working on replica secondaries (eg. the /rest/host/:id) - Remove HTML output from Total Compliance report 3.0.x: Removed unused options "[-t][-r][-u]" from cf-know 3.0.1: $(sys.licenses_installtime) variable removed from "Enterprise Free" 3.0.0: New Reporting Engine: A SQL interface to reports collected by hub. We allow all standardised SQL SELECT constructs to query the SQL reports database, with the following additions: - TIMESTAMP_UNIX() - seconds elapsed since 1970 - TIMESTAMP_UNIX_DAYS() - days elapsed since 1970 These are added to avoid use of non-portable SQL date/time functions. Enterprise API: - Read + write REST interface for - report querying(utilizes underlying reporting engine) - user management - can be used with REST API v1 in parallel - Configurable hostnames(host/system identifier) in reports - can take any of the sys variables(eg.$(sys.fqhost)) - When decommissioning (deleting a host) from the Mission Portal/Enterprise API, the public keys of the clients are also removed - Ability to delete multiple hosts from the mission portal - Improvements on the hub maintenance process less resource intensive and configurable - New option for cf-hub added (-m) for Enterprise database maintenance - Fixes on database connections problems - If you were seeing "connection refused because too many open connections", in database log please consider upgrading - Changed "nova>" to "enterprise>" in agent verbose output - Please update email filters - Removed internal CFE promises from reporting - New classes enterprise, enterprise_X, enterprise_X_Y, enterprise_X_Y_Z on CFEngine Enterprise, to reflect the version running. New variable sys.enterprise_version that holds the CFEngine Enterprise version. This complements the Nova classes and the sys.nova_version variable, which will eventually be deprecated. - Fix file change report containing warning message as filename for new/deleted files - File diff log (nova_diff.log) have been extended with promise handle name. - Total compliance output in cf-agent verbose mode and promise_summary.log have been extended with user and cfengine internal compliance level. - System variables are collected by hub in every delta query - Fix software reports showing "(never)" in the "Last seen" column - Fix "blue hosts" list being empty for clients that don't have class keys - Sendmail is installed by default on the hub - required for emailing of reports - 32-bit hub installations no longer supported - Created a variable update_policy.mongodb_dir, for cases where MongoDB should not run out of /var/cfengine/state (could grow to tens of gigabytes). - Removed commercial_customer class, as it was unused in internal policies. Please use enterprise_edition instead if you used this in your policies. - New performance report events: DBPurgeHostsAll, DBMaintenance, DBMaintenanceTimestampsSingleHost, DBCacheCompliance, DBReportCollectAll. - License verification is made more robust by not relying on the last-seen database anymore. This means you do not need to bootstrap a client to verify the license. See the cf-key --install-license option. 2.2.0 - More diagnostics on report collection from cf-hub. Logging more useful information in cf-hub -l, measuring total collection time in benchmarks report, under id "ReportCollectAll". - Fixed issue where client would show as green in the Mission Portal when no data was received, e.g. due to access or license error at client. Now correctly shows as blue in these cases. - Greatly reduced amount of connections from cf-hub to localhost mongodb. Now there is one connection per cf-hub run (max 50), before it was three per client. - Software and variable report now contains end-node discovery time. - Software and patches available/status reports contain maximum 5-minute old data, improved from 6 hours in last release. This will only apply to clients that are upgraded to 2.2.0. - Software report query from Mission Portal is much faster on larger data-sets due to removal of autocomplete feature. - Upgraded mongod from version 1.8.2 to 2.0.4, which increases efficiency on concurrency and reduces memory usage. - New function hostswithclass() that generates a list of hosts in a given class on the hub. - The bundled failsafe.cf policy now has trustkey=false to avoid IP spoofing attacks in default policy 2.1.0 - New interface with interactive graphs on Nova hub. - User management on hub. - Allowing TAB in file diff report. Better handling of large diffs and attempts to diff binaries. - Support for adding notes to all hosts and reports. - Support for policy staging environments. - Nova reports can be exported to file and imported manually using cf-report -x and cf-report -i. - Faster collection of monitoring (vitals) data due to new protocol and data structure. - Long-term storage (one year) of diff and changes reports. - The variables report got a last-seen column. Now variables are stored in the hub for a longer time like classes, and not overwritten on every update. - The report of reports-promises are shown in the promise repaired log in the Mission Portal. - New option cf-hub --cache, recreates the cache data needed by the web interface. - Only showing the last seen host name and ip address when listing hosts and on the host page. - Reliability improvements, especially when querying the variables report. 2.0.2 - Much faster report querying. - Allows to specify age interval when querying promise not kept and repaired. - Promiser conflict identifcation. - Built with Cfengine Community Edition 3.1.4. 2.0.1 - Fixed promise query of not kept/promise repaired logs. 1.2.0: - Windows Event Logs include output_prefix if set, and which component reported the event. The verbosity of event logs have been reduced by not including promise kept and repaired events, this can now be tuned with action.log_level. - Take out network communications from total state calculation, as it gets counted twice. 1.1.2: - Encryption problems fixed in Community Edition. - Built with Cfengine Community Edition 3.0.4p3. 1.1.0: - Regular expressions in file paths supported on Windows by using forward slash as path separator. - CPU utilization report on Windows. Users logged in report on Windows. - On the Windows cf-serverd, requests for /var/cfengine are translated to $(sys.workdir)\Cfengine, and path separators are automatically adjusted ("/" becomes "\"). This yields support for more platform-independent promises and allows for automatic copying of reports from Windows clients to the policy server. - Scale on graphs in the Knowledge Map, and different background color gives more readability. - Special functions added for accessing remote classes for distributed cooperation. 1.0.0: - Reports added to cf-report for compliance, setuid, file_changes etc. Added csv format also - Automating topic map integration of policy, with impact analysis using promisee and builds_on promises. - Literal string lookup in server. - Database SQL and registry functions added. Verification and sanity checking of SQL database table structure. Create and destroy databases convergently. - Access control list support for Linux. - Powerful and lightweight promises for Customizable monitoring and system discovery promises added to cf-monitord. - Longterm memory for 3 year trend analysis.
Supported platforms and versions
CFEngine works on a wide range of platforms, and the CFEngine team strives to provide support for the platforms most frequently used by our users. CFEngine provides binary packages of the Enterprise edition for all supported platforms and binary packages for popular Linux distributions for the Community edition.
Hub
Platform | Versions | Architecture |
---|---|---|
CentOS/RHEL | 7, 8.1+, 9 | x86-64 |
Debian | 9, 10, 11, 12 | x86-64 |
Debian | 11, 12 | arm64 |
Ubuntu | 16.04, 18.04, 20.04, 22.04 | x86-64 |
Ubuntu | 22.04 | arm64 |
Any supported host can be a policy server in Community installations of CFEngine.
Clients
Platform | Versions | Architectures |
---|---|---|
AIX | 7.1, 7.2 | PowerPC |
CentOS/RHEL | 6, 7, 8.1, 9 | x86-64 |
Debian | 9, 10, 11, 12 | x86-64 |
Debian | 11, 12 | arm64 |
HP-UX | 11.31+ | Itanium |
SLES | 12, 15 | x86-64 |
Solaris | 11 | UltraSparc |
Ubuntu | 16.04 18.04, 20.04, 22.04 | x86-64 |
Ubuntu | 22.04 | arm64 |
Windows | 2012, 2016, 2019 | x86-64, x86 |
Known issues also includes platform-specific notes.
CFEngine Enterprise has Virtual I/O Server (VIOS) Recognized status from IBM. This means that CFEngine Enterprise has been technically verified by IBM to be installed in and manage VIOS environments.
Future platform support
The CFEngine team will continue to support future releases of popular Host platforms, including RHEL, Debian, Ubuntu, as well as maintaining support for existing platforms important to users.
In general, CFEngine is known to run on a wide range of other platforms. As long as the platform is POSIX compliant and has a C compiler toolchain that fully implements the C99 standard, we are happy to work with you to make CFEngine available. Please contact our sales team for details.
Known issues
CFEngine defects are managed in our bug tracker. Please report bugs or unexpected behavior there, following the documented guideline for new bug reports.
- Issues affecting 3.24
- Issues fixed in 3.24
Legal and licenses
General legal disclaimer
Please note that unless otherwise noted (through a customer agreement or similar) CFEngine is offered on an "as is" basis without warranty of any kind, and that our products are not error or bug free. To the maximum extent permitted by applicable law, CFEngine on behalf of itself and its suppliers, disclaims all warranties and conditions, either express or implied, including, but not limited to, implied warranties of merchantability, fitness for a particular purpose, title and non-infringement with regard to the Licensed Software.
CFEngine documentation license
The documentation is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
3rd party licenses and libraries
CFEngine includes the following 3rd party libraries and components:
Common dependencies
These dependencies are used by both CFEngine Community (Open Source) as well as CFEngine Enterprise:
- libacl under the LGPL license
- libattr under the LGPL license
- libcurl under the MIT/X derivative license
- libiconv under the LGPL license
- libxml2 under the MIT license
- libyaml under the MIT license
- diffutils under the GPLv3
- LMDB under the OpenLDAP Public License
- OpenSSL under the OpenSSL (OpenSSL 1) or Apache v2 (OpenSSL 3) license
- PCRE under the PCRE license or PCRE2 under the PCRE2 license
- PEG under the MIT license
- zlib under the zlib license
Enterprise only dependencies
In addition to the common dependencies listed above, these dependencies are specific to CFEngine Enterprise:
- Angular.js under the MIT license
- Apache under the Apache License, Version 2.0
- APR and APR-util under the Apache License, Version 2.0
- Chosen under the MIT license
- CodeIgniter under the MIT license
- Disphelper (only Windows) under the BSD license
- Flot under the MIT license
- Font Awesome by Dave Gandy - https://fontawesome.io/license/
- git under the GNU General Public License, version 2 (GPLv2)
- Glyphicons under Creative Commons Attribution 3.0 Unported (CC BY 3.0)
- HighCharts under the OEM license by HighSoft
- jQuery under the MIT license
- libexpat under the MIT license
- libgnurx under the LGPLv2.1 license
- mod_ssl under a BSD style license
- oauth2-server-php under the MIT license
- OpenLDAP and liblber under the OpenLDAP Public License
- PHP under the PHP license
- PostgreSQL under the PostgreSQL License
- rsync under the GPLv3
- Twitter Bootstrap Framework under Apache License, Version 2.0
- Bootstrap Icons under the MIT license
- underscore.js under the MIT license
- ace-builds under the BSD-3-Clause license
- angular under the MIT license
- angular-chosen-localytics under the MIT license
- angular-daterangepicker under the MIT license
- angular-ui under the MIT license
- bootstrap-multiselect under the Apache License, Version 2.0
- bootstrap-tour under the MIT license
- chosen-js under the MIT license
- clipboard under the MIT license
- datatables under the MIT license
- daterangepicker under the MIT license
- google-code-prettify under the Apache License 2.0
- highcharts under the SLA license
- html5shiv under the MIT license and GPL2
- ip-subnet-calculator under the MIT license
- jquery under the MIT license
- jquery-appear-original under the MIT license
- jquery-form under the MIT license
- jquery-multiselect under the MIT license
- jquery-ui-timepicker-addon under the MIT license
- jquery-validation under the MIT license
- jquery-wheelcolorpicker under the MIT license
- jquery.cookie under the MIT license
- jquery.flot under the MIT license
- json2 under the GNU Lesser General Public License
- jstimezonedetect under the MIT license
- notifyjs under the MIT license
- pluralize under the MIT license
- zxcvbn under the MIT license
- FPDF under the permissive license
- guzzle under the MIT license
- tcpdf under the GNU LESSER GENERAL PUBLIC LICENSE
- Slim under the MIT
- monolog under the MIT
- LdapRecord under the MIT
- phpseclib under the MIT
- tonic under the MIT
Optional, non-default dependencies
These dependencies are not a part of the packages we build and distribute, but specific users or customers may build CFEngine with support for custom functionality and with custom software dependencies:
- libvirt under the LGPL version 2.1
- QDBM under the GNU Library or Lesser General Public License 2.0 (LGPLv2)
- TokyoCabinet under the GNU Lesser General Public License