Jan 02 11:17:17 leader systemd[1]: Started pioreactor_startup_run@mqtt_to_db_streaming.service - Start up mqtt_to_db_streaming on boot..
Jan 02 11:17:19 leader pio[688]: 2025-01-02T11:17:19+0000 DEBUG [mqtt_to_db_streaming] Init.
Jan 02 11:17:19 leader pio[688]: 2025-01-02T11:17:19+0000 DEBUG [mqtt_to_db_streaming] Streaming MQTT data to /home/pioreactor/.pioreactor/storage/p>
Jan 02 11:17:19 leader pio[688]: 2025-01-02T11:17:19+0000 DEBUG [mqtt_to_db_streaming] Listening to [TopicToParserToTable(topic='pioreactor/+/+/spec>
Jan 02 11:17:19 leader pio[688]: Traceback (most recent call last):
Jan 02 11:17:19 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/mureq.py", line 167, in yield_response
Jan 02 11:17:19 leader pio[688]: conn.request(method, path, headers=headers, body=body)
Jan 02 11:17:19 leader pio[688]: File "/usr/lib/python3.11/http/client.py", line 1282, in request
Jan 02 11:17:19 leader pio[688]: self._send_request(method, url, body, headers, encode_chunked)
Jan 02 11:17:19 leader pio[688]: File "/usr/lib/python3.11/http/client.py", line 1328, in _send_request
Jan 02 11:17:19 leader pio[688]: self.endheaders(body, encode_chunked=encode_chunked)
Jan 02 11:17:19 leader pio[688]: File "/usr/lib/python3.11/http/client.py", line 1277, in endheaders
Jan 02 11:17:19 leader pio[688]: self._send_output(message_body, encode_chunked=encode_chunked)
Jan 02 11:17:19 leader pio[688]: File "/usr/lib/python3.11/http/client.py", line 1037, in _send_output
Jan 02 11:17:19 leader pio[688]: self.send(msg)
Jan 02 11:17:19 leader pio[688]: File "/usr/lib/python3.11/http/client.py", line 975, in send
Jan 02 11:17:19 leader pio[688]: self.connect()
Jan 02 11:17:19 leader pio[688]: File "/usr/lib/python3.11/http/client.py", line 941, in connect
Jan 02 11:17:19 leader pio[688]: self.sock = self._create_connection(
Jan 02 11:17:19 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:19 leader pio[688]: File "/usr/lib/python3.11/socket.py", line 851, in create_connection
Jan 02 11:17:19 leader pio[688]: raise exceptions[0]
Jan 02 11:17:19 leader pio[688]: File "/usr/lib/python3.11/socket.py", line 836, in create_connection
Jan 02 11:17:19 leader pio[688]: sock.connect(sa)
Jan 02 11:17:19 leader pio[688]: ConnectionRefusedError: [Errno 111] Connection refused
Jan 02 11:17:19 leader pio[688]: The above exception was the direct cause of the following exception:
Jan 02 11:17:19 leader pio[688]: Traceback (most recent call last):
Jan 02 11:17:19 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/whoami.py", line 52, in _get_assigned_experiment_name
Jan 02 11:17:19 leader pio[688]: result = get_from_leader(f"/api/workers/{unit_name}/experiment")
Jan 02 11:17:19 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:19 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/pubsub.py", line 374, in get_from_leader
Jan 02 11:17:19 leader pio[688]: return get_from(leader_address, endpoint, **kwargs)
Jan 02 11:17:19 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/pubsub.py", line 370, in get_from
Jan 02 11:17:20 leader pio[688]: return mureq.get(create_webserver_path(address, endpoint), **kwargs)
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/mureq.py", line 68, in get
Jan 02 11:17:20 leader pio[688]: return request("GET", url=url, **kwargs)
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/mureq.py", line 51, in request
Jan 02 11:17:20 leader pio[688]: with yield_response(method, url, **kwargs) as response:
Jan 02 11:17:20 leader pio[688]: File "/usr/lib/python3.11/contextlib.py", line 137, in __enter__
Jan 02 11:17:20 leader pio[688]: return next(self.gen)
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/mureq.py", line 174, in yield_response
Jan 02 11:17:20 leader pio[688]: raise HTTPException(str(e)) from e
Jan 02 11:17:20 leader pio[688]: http.client.HTTPException: [Errno 111] Connection refused
Jan 02 11:17:20 leader pio[688]: During handling of the above exception, another exception occurred:
Jan 02 11:17:20 leader pio[688]: Traceback (most recent call last):
Jan 02 11:17:20 leader pio[688]: File "/usr/local/bin/pio", line 8, in <module>
Jan 02 11:17:20 leader pio[688]: sys.exit(pio())
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1157, in __call__
Jan 02 11:17:20 leader pio[688]: return self.main(*args, **kwargs)
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1078, in main
Jan 02 11:17:20 leader pio[688]: rv = self.invoke(ctx)
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1688, in invoke
Jan 02 11:17:20 leader pio[688]: return _process_result(sub_ctx.command.invoke(sub_ctx))
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1688, in invoke
Jan 02 11:17:20 leader pio[688]: return _process_result(sub_ctx.command.invoke(sub_ctx))
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1434, in invoke
Jan 02 11:17:20 leader pio[688]: return ctx.invoke(self.callback, **ctx.params)
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 783, in invoke
Jan 02 11:17:20 leader pio[688]: return __callback(*args, **kwargs)
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/background_jobs/leader/mqtt_to_db_streaming.py", line 508>
Jan 02 11:17:20 leader pio[688]: job = start_mqtt_to_db_streaming()
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/background_jobs/leader/mqtt_to_db_streaming.py", line 496>
Jan 02 11:17:20 leader pio[688]: return MqttToDBStreamer(get_unit_name(), UNIVERSAL_EXPERIMENT, source_to_sinks)
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/background_jobs/base.py", line 105, in __call__
Jan 02 11:17:20 leader pio[688]: obj = type.__call__(cls, *args, **kwargs)
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/background_jobs/leader/mqtt_to_db_streaming.py", line 86,>
Jan 02 11:17:20 leader pio[688]: self.timer = RepeatedTimer(60, self.write_stats).start()
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/utils/timing.py", line 112, in __init__
Jan 02 11:17:20 leader pio[688]: self.logger = create_logger(
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/logging.py", line 178, in create_logger
Jan 02 11:17:20 leader pio[688]: experiment = get_assigned_experiment_name(unit)
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/whoami.py", line 36, in get_assigned_experiment_name
Jan 02 11:17:20 leader pio[688]: return _get_assigned_experiment_name(unit_name)
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/whoami.py", line 66, in _get_assigned_experiment_name
Jan 02 11:17:20 leader pio[688]: raise mureq.HTTPException(
Jan 02 11:17:20 leader pio[688]: http.client.HTTPException: Not able to access experiments in UI. Check http://127.0.0.1 is online and check network.
Jan 02 11:17:20 leader pio[688]: 2025-01-02T11:17:20+0000 DEBUG [mqtt_to_db_streaming] Exiting caused by Python atexit.
Jan 02 11:17:20 leader pio[688]: 2025-01-02T11:17:20+0000 DEBUG [mqtt_to_db_streaming] Error in on_disconnected:
Jan 02 11:17:20 leader pio[688]: 2025-01-02T11:17:20+0000 DEBUG [mqtt_to_db_streaming] 'MqttToDBStreamer' object has no attribute 'timer'
Jan 02 11:17:20 leader pio[688]: Traceback (most recent call last):
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/background_jobs/base.py", line 769, in disconnected
Jan 02 11:17:20 leader pio[688]: self.on_disconnected()
Jan 02 11:17:20 leader pio[688]: File "/usr/local/lib/python3.11/dist-packages/pioreactor/background_jobs/leader/mqtt_to_db_streaming.py", line 97,>
Jan 02 11:17:20 leader pio[688]: self.timer.cancel()
Jan 02 11:17:20 leader pio[688]: ^^^^^^^^^^
Jan 02 11:17:20 leader pio[688]: AttributeError: 'MqttToDBStreamer' object has no attribute 'timer'
Jan 02 11:17:20 leader pio[688]: 2025-01-02T11:17:20+0000 INFO [mqtt_to_db_streaming] Disconnected.
Jan 02 11:25:34 leader pio[688]: 2025-01-02T11:25:34+0000 DEBUG [mqtt_to_db_streaming] Disconnected successfully from MQTT.
Jan 02 11:25:36 leader systemd[1]: pioreactor_startup_run@mqtt_to_db_streaming.service: Main process exited, code=exited, status=1/FAILURE
Jan 02 11:25:36 leader systemd[1]: pioreactor_startup_run@mqtt_to_db_streaming.service: Failed with result 'exit-code'.
Jan 02 11:25:36 leader systemd[1]: pioreactor_startup_run@mqtt_to_db_streaming.service: Consumed 1.843s CPU time.