Created attachment 398612 [details] elasticsearch-curator-3.0.0.ebuild Release Notes The full release of Curator 3.0 is out! Check out all of the changes here! Note: This release is not reverse compatible with any previous version. Because 3.0 is a major point release, there have been some major changes to both the API as well as the CLI arguments and structure. Be sure to read the updated command-line specific docs in the wiki and change your command-line arguments accordingly. The API docs are still at http://curator.readthedocs.org. Be sure to read the latest docs, or select the docs for 3.0.0. General Breaking changes to the API. Because this is a major point revision, changes to the API have been made which are non-reverse compatible. Before upgrading, be sure to update your scripts and test them thoroughly. Python 3 support Somewhere along the line, Curator would no longer work with curator. All tests now pass for both Python2 and Python3, with 99% code coverage in both environments. New CLI library. Using Click now. http://click.pocoo.org/3/ This change is especially important as it allows very easy CLI integration testing. Pipelined filtering! You can now use --older-than & --newer-than in the same command! You can also provide your own regex via the --regex parameter. You can use multiple instances of the --exclude flag. Manually include indices! With the --index paramter, you can add an index to the working list. You can provide multiple instances of the --index parameter as well! Tests! So many tests now. Test coverage of the API methods is at 100% now, and at 99% for the CLI methods. This doesn't mean that all of the tests are perfect, or that I haven't missed some scenarios. It does mean, however, that it will be much easier to write tests if something turns up missed. It also means that any new functionality will now need to have tests. Iteration changes: Methods now only iterate through each index when appropriate! In fact, the only commands that iterate are alias and optimize. The bloom command will iterate, but only if you have added the --delay flag with a value greater than zero. Improved packaging! Methods have been moved into categories of api and cli, and further broken out into individual modules to help them be easier to find and read. Check for allocation before potentially re-applying an allocation rule. #273 (ferki) Assigning replica count and routing allocation rules can be done to closed indices. #283 (ferki) Bug fixes Don't accidentally delete .kibana index. #261 (malagoli) Fix segment count for empty indices. #265 (untergeek) Change bloom filter cutoff Elasticsearch version to 1.4. Reported in #267 (untergeek)
--- /usr/portage/dev-python/elasticsearch-curator/elasticsearch-curator-2.1.2.ebuild 2015-02-17 15:13:27.000000000 +0100 +++ elasticsearch-curator/elasticsearch-curator-3.0.0.ebuild 2015-03-10 15:55:28.700916547 +0100 @@ -4,10 +4,10 @@ EAPI=5 -PYTHON_COMPAT=( python2_7 ) +PYTHON_COMPAT=( python{2_7,3_3,3_4} ) MY_PN="curator" -ES_VERSION="1.4.2" +ES_VERSION="1.4.4" inherit distutils-r1 @@ -23,7 +23,8 @@ RDEPEND=" >=dev-python/elasticsearch-py-1.0.0[${PYTHON_USEDEP}] - <dev-python/elasticsearch-py-2.0.0[${PYTHON_USEDEP}]" + <dev-python/elasticsearch-py-2.0.0[${PYTHON_USEDEP}] + >=dev-python/click-3.3[${PYTHON_USEDEP}]" DEPEND="dev-python/setuptools[${PYTHON_USEDEP}] test? ( ${RDEPEND} virtual/jre:1.7 @@ -42,7 +43,7 @@ PID="${ES}/elasticsearch.pid" # run Elasticsearch instance on custom port - sed -i "s/#http.port: 9200/http.port: ${ES_PORT}/g" ${ES}/config/elasticsearch.yml + sed -i "s/#http.port: 9200/http.port: ${ES_PORT}/g;s/#cluster.name: elasticsearch/cluster.name: gentoo-es-curator-test/g" ${ES}/config/elasticsearch.yml ${ES}/bin/elasticsearch -d -p ${PID} for i in `seq 10`; do @@ -77,3 +78,13 @@ use doc && local HTML_DOCS=( docs/_build/html/. ) distutils-r1_python_install_all } + +pkg_postinst() { + ewarn "" + ewarn "For Python 3 support information please read: http://click.pocoo.org/3/python3/" + ewarn "" + ewarn "Example usage on Python 3:" + ewarn "export LC_ALL=en_US.UTF-8" + ewarn "export LANG=en_US.UTF-8" + ewarn "curator ..." +}
- added Python 3 support - explicit set cluster.name - if there are other ES nodes on the net then (some) tests will fail because they need a shared storage. By setting the name we are creating an isolated "cluster".
During test phase of python3.3 got alot of; Traceback (most recent call last): File "/usr/lib64/python3.3/site-packages/urllib3/connectionpool.py", line 516, in urlopen body=body, headers=headers) File "/usr/lib64/python3.3/site-packages/urllib3/connectionpool.py", line 308, in _make_request conn.request(method, url, **httplib_request_kw) File "/usr/lib64/python3.3/http/client.py", line 1065, in request self._send_request(method, url, body, headers) File "/usr/lib64/python3.3/http/client.py", line 1103, in _send_request self.endheaders(body) File "/usr/lib64/python3.3/http/client.py", line 1061, in endheaders self._send_output(message_body) File "/usr/lib64/python3.3/http/client.py", line 906, in _send_output self.send(msg) File "/usr/lib64/python3.3/http/client.py", line 844, in send self.connect() File "/usr/lib64/python3.3/site-packages/urllib3/connection.py", line 141, in connect conn = self._new_conn() File "/usr/lib64/python3.3/site-packages/urllib3/connection.py", line 120, in _new_conn (self.host, self.port), self.timeout, **extra_kw) File "/usr/lib64/python3.3/site-packages/urllib3/util/connection.py", line 85, in create_connection raise err File "/usr/lib64/python3.3/site-packages/urllib3/util/connection.py", line 76, in create_connection sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib64/python3.3/site-packages/elasticsearch/connection/http_urllib3.py", line 67, in perform_request response = self.pool.urlopen(method, url, body, retries=False, headers=self.headers, **kw) File "/usr/lib64/python3.3/site-packages/urllib3/connectionpool.py", line 559, in urlopen _pool=self, _stacktrace=stacktrace) File "/usr/lib64/python3.3/site-packages/urllib3/util/retry.py", line 223, in increment raise six.reraise(type(error), error, _stacktrace) File "/usr/lib64/python3.3/site-packages/six.py", line 624, in reraise raise value.with_traceback(tb) File "/usr/lib64/python3.3/site-packages/urllib3/connectionpool.py", line 516, in urlopen body=body, headers=headers) File "/usr/lib64/python3.3/site-packages/urllib3/connectionpool.py", line 308, in _make_request conn.request(method, url, **httplib_request_kw) File "/usr/lib64/python3.3/http/client.py", line 1065, in request self._send_request(method, url, body, headers) File "/usr/lib64/python3.3/http/client.py", line 1103, in _send_request self.endheaders(body) File "/usr/lib64/python3.3/http/client.py", line 1061, in endheaders self._send_output(message_body) File "/usr/lib64/python3.3/http/client.py", line 906, in _send_output self.send(msg) File "/usr/lib64/python3.3/http/client.py", line 844, in send self.connect() File "/usr/lib64/python3.3/site-packages/urllib3/connection.py", line 141, in connect conn = self._new_conn() File "/usr/lib64/python3.3/site-packages/urllib3/connection.py", line 120, in _new_conn (self.host, self.port), self.timeout, **extra_kw) File "/usr/lib64/python3.3/site-packages/urllib3/util/connection.py", line 85, in create_connection raise err File "/usr/lib64/python3.3/site-packages/urllib3/util/connection.py", line 76, in create_connection sock.connect(sa) urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionRefusedError(111, 'Connection refused')) elasticsearch: DEBUG: > None urllib3.util.retry: DEBUG: Converted retries value: False -> Retry(total=False, connect=None, read=None, redirect=0) urllib3.connectionpool: INFO: Starting new HTTP connection (398): localhost elasticsearch: WARNING: GET http://localhost:25123/_cluster/health?wait_for_status=yellow [status:N/A request:0.001s] then it ended XML: /mnt/gen2/TmpDir/portage/dev-python/elasticsearch-curator-3.0.0/work/curator-3.0.0/nosetests.xml Name Stmts Miss Cover Missing -------------------------------------------------------------- curator 3 0 100% curator._version 1 0 100% curator.api 12 0 100% curator.api.alias 56 14 75% 28-29, 33, 38-39, 63, 81-90 curator.api.allocation 23 0 100% curator.api.bloom 31 2 94% 21-22 curator.api.close 15 0 100% curator.api.delete 17 0 100% curator.api.filter 119 0 100% curator.api.opener 14 0 100% curator.api.optimize 35 2 94% 38-39 curator.api.replicas 18 0 100% curator.api.show 5 0 100% curator.api.snapshot 50 0 100% curator.api.utils 132 10 92% 24-31, 75-76, 256 curator.cli 14 0 100% curator.cli.alias 13 4 69% 14-17 curator.cli.allocation 13 4 69% 14-17 curator.cli.bloom 8 0 100% curator.cli.cli 47 22 53% 12-17, 52-83 curator.cli.close 7 0 100% curator.cli.delete 11 0 100% curator.cli.index_selection 64 45 30% 45-108 curator.cli.opener 7 0 100% curator.cli.optimize 10 0 100% curator.cli.replicas 12 4 67% 13-16 curator.cli.show 9 0 100% curator.cli.snapshot 20 4 80% 38-41 curator.cli.snapshot_selection 60 40 33% 45-100 curator.cli.utils 109 67 39% 36, 39-45, 49, 52, 79-91, 98-133, 157-182 -------------------------------------------------------------- TOTAL 935 218 77% ---------------------------------------------------------------------- Ran 137 tests in 17.990s OK (SKIP=1) * python3_3: running distutils-r1_run_phase _clean_egg_info >>> Completed testing dev-python/elasticsearch-curator-3.0.0 appearing to have actually completed. -rw-rw---- 1 testuser portage 1539050 Mar 17 18:03 /mnt/gen2/TmpDir/portage/dev-python/elasticsearch-curator-3.0.0/temp/build.log 1.5 mb of build log has alot of Traceback (most recent call last):. ALOT
Created attachment 399124 [details] build.log Build log with tests.
Created attachment 399132 [details] elasticsearch-curator-3.0.0.ebuild Split long lines
*elasticsearch-curator-3.0.0 (18 Mar 2015) 18 Mar 2015; Ian Delaney <idella4@gentoo.org> +elasticsearch-curator-3.0.0.ebuild: bump; final form run tested, minor touches made to final attachment, fixes bug #542828
