The patch adds ability to configure REDIS as cache
backed for salt-master to be used as distibuted cache
further.

Change-Id: I62a29713c23ad3f591f6e937bfc5b13eba92f402
Related-PROD: PROD-20581

Change-Id: Iee0165a071ed29fd1ffc63b88edf687247c396d4

Change-Id: I7572d8e16e9126d5164a683ccf99b21f4c280cdb

Change-Id: I9d834d67e29d7c6d0b11599b0b543427cf1d7706

Change-Id: Idf6c18597a222e6c1b60bf940eadb1d6d8a611c7

Change-Id: I80688ac08182321d2509feb574f826f9829b3000

Change-Id: I96e16a3b203f9b3c9c150db1cb85e966bd14b573

PROD-16375

Change-Id: I758d38701cdf0e1cc6fa99c38192de2f9052468c

Change-Id: I5c88d22589ec1fa6a9806c1a625b752dd4fc8b54

Change-Id: I772495c38ed5dc21ad833f3c0f351384942e2b23

Change-Id: I336b0825712218e2381e1654251765a24581da00

Change-Id: Ic9decbeaf57e9aba2f95c3dd616393dc32763fcc

Currently the CI job fails with module not found errror.
AttributeError: 'module' object has no attribute 'check_refresh

The reason is new version of salt tries to call
salt.utils.pkg.check_refresh which is not available in 2016.11.3 but is
available in 2016.11.6.
Reference:
1. https://github.com/saltstack/salt/blob/v2016.11.3/salt/states/pkg.py
2. https://github.com/saltstack/salt/blob/v2016.11.6/salt/states/pkg.py#L1819

The fix proposed here is to use pkg.installed instead of pkg.latest.
It's not a good idea to always update salt whenever the salt state is
run, this may introduce failures unknown to the user. There is a pipeline
to update packages which should be used for updating to latest.
pkg.latest generally isn't a good way to write idempotent formulas. See
official salt docs: "Generally it is better for the installed function
to be used, as latest will update the package whenever a new package is
available."

Change-Id: I8da5c36c1613e54768993080f2514afc920c49f8

Change-Id: Ic64656c6fc3d4f561226d884b8bfb535dd537e14

Previous approach fails when all of formulas are installed from git.

Change-Id: I0622461ee6469c59c1fd3ad4a23cdaeaeee1b444

Install all pkgs for formulas together.

source:engine metadata created - defaults to pkg
installation, pip installation alternative added