Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

local elasticstack: bumps docker and k8s from 8.17.2 -> 8.17.4 #442

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

codefromthecrypt
Copy link
Collaborator

No description provided.

@codefromthecrypt
Copy link
Collaborator Author

arm build is failing for some reason. it doesn't print out the "awaiting ML jobs" part, which is maybe a smoking gun

/usr/local/lib/python3.12/site-packages/opentelemetry/instrumentation/elasticsearch/__init__.py:213: Warning: Instrumentation disabled, relying on elasticsearch native OTel support, see https://opentelemetry-python-contrib.readthedocs.io/en/latest/instrumentation/elasticsearch/elasticsearch.html
  warnings.warn(
".elser_model_2" model not available, downloading it now
".elser_model_2" model is deployed
".elser_model_2" model is ready
Loading data from $/app/data/data.json
Loaded 15 documents
Split 15 documents into 26 chunks
Creating Elasticsearch sparse vector store for http://localhost:9200
Adding documents to index workplace-app-docs
/app/data/index_data.py:141: UserWarning: Error occurred, will retry after ML jobs complete: Connection timed out
  warn(f"Error occurred, will retry after ML jobs complete: {e}")
/app/data/index_data.py:184: GeneralAvailabilityWarning: This API is in technical preview and may be changed or removed in a future release. Elastic will work to fix any issues, but features in technical preview are not subject to the support SLA of official GA features.
  resp = es.tasks.list(detailed=True, actions=["cluster:monitor/xpack/ml/*"])
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/urllib3/connectionpool.py", line 534, in _make_request
    response = conn.getresponse()
               ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/urllib3/connection.py", line 516, in getresponse
    httplib_response = super().getresponse()
                       ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/http/client.py", line 1430, in getresponse
    response.begin()
  File "/usr/local/lib/python3.12/http/client.py", line 331, in begin
    version, status, reason = self._read_status()
                              ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/http/client.py", line 292, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/socket.py", line 720, in readinto
    return self._sock.recv_into(b)
           ^^^^^^^^^^^^^^^^^^^^^^^
TimeoutError: timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/elastic_transport/_node/_http_urllib3.py", line 167, in perform_request
    response = self.pool.urlopen(
               ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/opentelemetry/instrumentation/urllib3/__init__.py", line 364, in instrumented_urlopen
  File "/usr/local/lib/python3.12/site-packages/urllib3/util/util.py", line 39, in reraise
    raise value
  File "/usr/local/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
    response = self._make_request(
               ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/urllib3/connectionpool.py", line 536, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.12/site-packages/urllib3/connectionpool.py", line 367, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='localhost', port=9200): Read timed out. (read timeout=9.999899645)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/bin/flask", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/usr/local/lib/python3.12/site-packages/flask/cli.py", line 1129, in main
    cli.main()
  File "/usr/local/lib/python3.12/site-packages/click/core.py", line [10](https://github.com/elastic/elasticsearch-labs/actions/runs/14298043194/job/40068065750?pr=442#step:7:11)82, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/click/core.py", line 1697, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/opentelemetry/instrumentation/click/__init__.py", line [11](https://github.com/elastic/elasticsearch-labs/actions/runs/14298043194/job/40068065750?pr=442#step:7:12)9, in _command_invoke_wrapper
    return wrapped(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.[12](https://github.com/elastic/elasticsearch-labs/actions/runs/14298043194/job/40068065750?pr=442#step:7:13)/site-packages/click/core.py", line 1443, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/click/core.py", line 788, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/click/decorators.py", line 33, in new_func
    return f(get_current_context(), *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/flask/cli.py", line 400, in decorator
    return ctx.invoke(f, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/click/core.py", line 788, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/app/api/app.py", line 37, in create_index
    index_data.main()
  File "/app/data/index_data.py", line 144, in main
    store.add_documents(list(docs))
  File "/usr/local/lib/python3.12/site-packages/langchain_core/vectorstores/base.py", line 287, in add_documents
    return self.add_texts(texts, metadatas, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/langchain_elasticsearch/_sync/vectorstores.py", line 625, in add_texts
    return self._store.add_texts(
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/elasticsearch/helpers/vectorstore/_sync/vectorstore.py", line [13](https://github.com/elastic/elasticsearch-labs/actions/runs/14298043194/job/40068065750?pr=442#step:7:14)8, in add_texts
    self._create_index_if_not_exists()
  File "/usr/local/lib/python3.12/site-packages/elasticsearch/helpers/vectorstore/_sync/vectorstore.py", line 335, in _create_index_if_not_exists
    self.retrieval_strategy.before_index_creation(
  File "/usr/local/lib/python3.12/site-packages/elasticsearch/helpers/vectorstore/_sync/strategies.py", line [16](https://github.com/elastic/elasticsearch-labs/actions/runs/14298043194/job/40068065750?pr=442#step:7:17)5, in before_index_creation
    model_must_be_deployed(client, self.model_id)
  File "/usr/local/lib/python3.12/site-packages/elasticsearch/helpers/vectorstore/_sync/_utils.py", line 28, in model_must_be_deployed
    client.ml.infer_trained_model(model_id=model_id, docs=[doc])
  File "/usr/local/lib/python3.12/site-packages/elasticsearch/_sync/client/utils.py", line 455, in wrapped
    return api(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/elasticsearch/_sync/client/ml.py", line 28[17](https://github.com/elastic/elasticsearch-labs/actions/runs/14298043194/job/40068065750?pr=442#step:7:18), in infer_trained_model
    return self.perform_request(  # type: ignore[return-value]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/elasticsearch/_sync/client/_base.py", line 423, in perform_request
    return self._client.perform_request(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/elasticsearch/_sync/client/_base.py", line 271, in perform_request
    response = self._perform_request(
               ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/elasticsearch/_sync/client/_base.py", line 316, in _perform_request
    meta, resp_body = self.transport.perform_request(
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/opentelemetry/instrumentation/elasticsearch/__init__.py", line 2[18](https://github.com/elastic/elasticsearch-labs/actions/runs/14298043194/job/40068065750?pr=442#step:7:19), in wrapper
    return wrapped(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/elastic_transport/_transport.py", line 342, in perform_request
    resp = node.perform_request(
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/elastic_transport/_node/_http_urllib3.py", line [20](https://github.com/elastic/elasticsearch-labs/actions/runs/14298043194/job/40068065750?pr=442#step:7:21)2, in perform_request
    raise err from e
elastic_transport.ConnectionTimeout: Connection timed out

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant