Jun 14 14:27:11 matrixim systemd[1]: Starting Synapse Matrix homeserver (master)...
Jun 14 14:27:12 matrixim synapse[12530]: This server is configured to use 'matrix.org' as its trusted key server via the
Jun 14 14:27:12 matrixim synapse[12530]: 'trusted_key_servers' config option. 'matrix.org' is a good choice for a key
Jun 14 14:27:12 matrixim synapse[12530]: server since it is long-lived, stable and trusted. However, some admins may
Jun 14 14:27:12 matrixim synapse[12530]: wish to use another server for this purpose.
Jun 14 14:27:12 matrixim synapse[12530]: To suppress this warning and continue using 'matrix.org', admins should set
Jun 14 14:27:12 matrixim synapse[12530]: 'suppress_key_server_warning' to 'true' in homeserver.yaml.
Jun 14 14:27:12 matrixim synapse[12530]: --------------------------------------------------------------------------------
Jun 14 14:27:12 matrixim systemd[1]: Started Synapse Matrix homeserver (master).
Jun 14 14:27:36 matrixim synapse[12530]: 2022-06-14 14:27:36,283 - synapse.federation.sender.per_destination_queue - 375 - ERROR - federation_transaction_transmission_loop-4 - TX [290618.xyz] Failed to send transaction
Jun 14 14:27:36 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:27:36 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:27:36 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:27:36 matrixim synapse[12530]: StopIteration: []
Jun 14 14:27:36 matrixim synapse[12530]: During handling of the above exception, another exception occurred:
Jun 14 14:27:36 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:27:36 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 280, in _transaction_transmission_loop
Jun 14 14:27:36 matrixim synapse[12530]:     await self._catch_up_transmission_loop()
Jun 14 14:27:36 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 495, in _catch_up_transmission_loop
Jun 14 14:27:36 matrixim synapse[12530]:     hosts = await self._state.get_hosts_in_room_at_events(
Jun 14 14:27:36 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 187, in get_hosts_in_room_at_events
Jun 14 14:27:36 matrixim synapse[12530]:     entry = await self.resolve_state_groups_for_events(room_id, event_ids)
Jun 14 14:27:36 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/util/metrics.py", line 113, in measured_func
Jun 14 14:27:36 matrixim synapse[12530]:     r = await func(self, *args, **kwargs)
Jun 14 14:27:36 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 352, in resolve_state_groups_for_events
Jun 14 14:27:36 matrixim synapse[12530]:     state_groups = await self._state_storage_controller.get_state_group_for_events(
Jun 14 14:27:36 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/controllers/state.py", line 341, in get_state_group_for_events
Jun 14 14:27:36 matrixim synapse[12530]:     return await self.stores.main._get_state_group_for_events(event_ids)
Jun 14 14:27:36 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:27:36 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:27:36 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/databases/main/state.py", line 376, in _get_state_group_for_events
Jun 14 14:27:36 matrixim synapse[12530]:     raise RuntimeError("No state group for unknown or outlier event %s" % e)
Jun 14 14:27:36 matrixim synapse[12530]: RuntimeError: No state group for unknown or outlier event $jbtBiWP_t7JZB2jrnUd_-DMDlhYvcLOMXbuw-RBobjQ
Jun 14 14:28:05 matrixim synapse[12530]: 2022-06-14 14:28:05,819 - synapse.federation.sender.per_destination_queue - 375 - ERROR - federation_transaction_transmission_loop-13 - TX [arcemtene.com] Failed to send transaction
Jun 14 14:28:05 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:05 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:05 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:05 matrixim synapse[12530]: StopIteration: []
Jun 14 14:28:05 matrixim synapse[12530]: During handling of the above exception, another exception occurred:
Jun 14 14:28:05 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:05 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 280, in _transaction_transmission_loop
Jun 14 14:28:05 matrixim synapse[12530]:     await self._catch_up_transmission_loop()
Jun 14 14:28:05 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 495, in _catch_up_transmission_loop
Jun 14 14:28:05 matrixim synapse[12530]:     hosts = await self._state.get_hosts_in_room_at_events(
Jun 14 14:28:05 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 187, in get_hosts_in_room_at_events
Jun 14 14:28:05 matrixim synapse[12530]:     entry = await self.resolve_state_groups_for_events(room_id, event_ids)
Jun 14 14:28:05 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/util/metrics.py", line 113, in measured_func
Jun 14 14:28:05 matrixim synapse[12530]:     r = await func(self, *args, **kwargs)
Jun 14 14:28:05 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 352, in resolve_state_groups_for_events
Jun 14 14:28:05 matrixim synapse[12530]:     state_groups = await self._state_storage_controller.get_state_group_for_events(
Jun 14 14:28:05 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/controllers/state.py", line 341, in get_state_group_for_events
Jun 14 14:28:05 matrixim synapse[12530]:     return await self.stores.main._get_state_group_for_events(event_ids)
Jun 14 14:28:05 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:05 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:05 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/databases/main/state.py", line 376, in _get_state_group_for_events
Jun 14 14:28:05 matrixim synapse[12530]:     raise RuntimeError("No state group for unknown or outlier event %s" % e)
Jun 14 14:28:05 matrixim synapse[12530]: RuntimeError: No state group for unknown or outlier event $jbtBiWP_t7JZB2jrnUd_-DMDlhYvcLOMXbuw-RBobjQ
Jun 14 14:28:07 matrixim synapse[12530]: 2022-06-14 14:28:07,026 - synapse.federation.sender.per_destination_queue - 375 - ERROR - federation_transaction_transmission_loop-14 - TX [azkware.net] Failed to send transaction
Jun 14 14:28:07 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:07 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:07 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:07 matrixim synapse[12530]: StopIteration: []
Jun 14 14:28:07 matrixim synapse[12530]: During handling of the above exception, another exception occurred:
Jun 14 14:28:07 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:07 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 280, in _transaction_transmission_loop
Jun 14 14:28:07 matrixim synapse[12530]:     await self._catch_up_transmission_loop()
Jun 14 14:28:07 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 495, in _catch_up_transmission_loop
Jun 14 14:28:07 matrixim synapse[12530]:     hosts = await self._state.get_hosts_in_room_at_events(
Jun 14 14:28:07 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 187, in get_hosts_in_room_at_events
Jun 14 14:28:07 matrixim synapse[12530]:     entry = await self.resolve_state_groups_for_events(room_id, event_ids)
Jun 14 14:28:07 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/util/metrics.py", line 113, in measured_func
Jun 14 14:28:07 matrixim synapse[12530]:     r = await func(self, *args, **kwargs)
Jun 14 14:28:07 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 352, in resolve_state_groups_for_events
Jun 14 14:28:07 matrixim synapse[12530]:     state_groups = await self._state_storage_controller.get_state_group_for_events(
Jun 14 14:28:07 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/controllers/state.py", line 341, in get_state_group_for_events
Jun 14 14:28:07 matrixim synapse[12530]:     return await self.stores.main._get_state_group_for_events(event_ids)
Jun 14 14:28:07 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:07 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:07 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/databases/main/state.py", line 376, in _get_state_group_for_events
Jun 14 14:28:07 matrixim synapse[12530]:     raise RuntimeError("No state group for unknown or outlier event %s" % e)
Jun 14 14:28:07 matrixim synapse[12530]: RuntimeError: No state group for unknown or outlier event $jbtBiWP_t7JZB2jrnUd_-DMDlhYvcLOMXbuw-RBobjQ
Jun 14 14:28:27 matrixim synapse[12530]: 2022-06-14 14:28:27,761 - synapse.federation.sender.per_destination_queue - 375 - ERROR - federation_transaction_transmission_loop-18 - TX [chat.hallertau.social] Failed to send transaction
Jun 14 14:28:27 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:27 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:27 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:27 matrixim synapse[12530]: StopIteration: []
Jun 14 14:28:27 matrixim synapse[12530]: During handling of the above exception, another exception occurred:
Jun 14 14:28:27 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:27 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 280, in _transaction_transmission_loop
Jun 14 14:28:27 matrixim synapse[12530]:     await self._catch_up_transmission_loop()
Jun 14 14:28:27 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 495, in _catch_up_transmission_loop
Jun 14 14:28:27 matrixim synapse[12530]:     hosts = await self._state.get_hosts_in_room_at_events(
Jun 14 14:28:27 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 187, in get_hosts_in_room_at_events
Jun 14 14:28:27 matrixim synapse[12530]:     entry = await self.resolve_state_groups_for_events(room_id, event_ids)
Jun 14 14:28:27 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/util/metrics.py", line 113, in measured_func
Jun 14 14:28:27 matrixim synapse[12530]:     r = await func(self, *args, **kwargs)
Jun 14 14:28:27 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 352, in resolve_state_groups_for_events
Jun 14 14:28:27 matrixim synapse[12530]:     state_groups = await self._state_storage_controller.get_state_group_for_events(
Jun 14 14:28:27 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/controllers/state.py", line 341, in get_state_group_for_events
Jun 14 14:28:27 matrixim synapse[12530]:     return await self.stores.main._get_state_group_for_events(event_ids)
Jun 14 14:28:27 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:27 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:27 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/databases/main/state.py", line 376, in _get_state_group_for_events
Jun 14 14:28:27 matrixim synapse[12530]:     raise RuntimeError("No state group for unknown or outlier event %s" % e)
Jun 14 14:28:27 matrixim synapse[12530]: RuntimeError: No state group for unknown or outlier event $j6Qxtlh-qcXquAz1rwD_9apbSIFn3x8D-9I5zTsJruA
Jun 14 14:28:29 matrixim synapse[12530]: 2022-06-14 14:28:29,963 - synapse.federation.sender.per_destination_queue - 375 - ERROR - federation_transaction_transmission_loop-21 - TX [chat.python.nz] Failed to send transaction
Jun 14 14:28:29 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:29 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:29 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:29 matrixim synapse[12530]: StopIteration: []
Jun 14 14:28:29 matrixim synapse[12530]: During handling of the above exception, another exception occurred:
Jun 14 14:28:29 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:29 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 280, in _transaction_transmission_loop
Jun 14 14:28:29 matrixim synapse[12530]:     await self._catch_up_transmission_loop()
Jun 14 14:28:29 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 495, in _catch_up_transmission_loop
Jun 14 14:28:29 matrixim synapse[12530]:     hosts = await self._state.get_hosts_in_room_at_events(
Jun 14 14:28:29 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 187, in get_hosts_in_room_at_events
Jun 14 14:28:29 matrixim synapse[12530]:     entry = await self.resolve_state_groups_for_events(room_id, event_ids)
Jun 14 14:28:29 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/util/metrics.py", line 113, in measured_func
Jun 14 14:28:29 matrixim synapse[12530]:     r = await func(self, *args, **kwargs)
Jun 14 14:28:29 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 352, in resolve_state_groups_for_events
Jun 14 14:28:29 matrixim synapse[12530]:     state_groups = await self._state_storage_controller.get_state_group_for_events(
Jun 14 14:28:29 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/controllers/state.py", line 341, in get_state_group_for_events
Jun 14 14:28:29 matrixim synapse[12530]:     return await self.stores.main._get_state_group_for_events(event_ids)
Jun 14 14:28:29 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:29 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:29 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/databases/main/state.py", line 376, in _get_state_group_for_events
Jun 14 14:28:29 matrixim synapse[12530]:     raise RuntimeError("No state group for unknown or outlier event %s" % e)
Jun 14 14:28:29 matrixim synapse[12530]: RuntimeError: No state group for unknown or outlier event $jbtBiWP_t7JZB2jrnUd_-DMDlhYvcLOMXbuw-RBobjQ
Jun 14 14:28:30 matrixim synapse[12530]: 2022-06-14 14:28:30,035 - synapse.federation.federation_server - 1156 - ERROR - _process_incoming_pdus_in_room_inner-0 - Failed to handle PDU $1655207512987evDoi:matrix.org
Jun 14 14:28:30 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:30 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:30 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:30 matrixim synapse[12530]: StopIteration: [{'event_id': '$16251075681Gbbts:matrixim.cc', 'state_group': 52844891}, {'event_id': '$162515856121841dqERW:matrix.org', 'state_group': 52846599}, {'event_id': '$162519360030472FEPHv:matrix.org', 'state_group': 52847652}, {'event_id': '$165133828877163lAQoh:matrix.org', 'state_group': 54303184}]
Jun 14 14:28:30 matrixim synapse[12530]: During handling of the above exception, another exception occurred:
Jun 14 14:28:30 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:30 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/handlers/federation_event.py", line 236, in on_receive_pdu
Jun 14 14:28:30 matrixim synapse[12530]:     await self._get_missing_events_for_pdu(
Jun 14 14:28:30 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/handlers/federation_event.py", line 687, in _get_missing_events_for_pdu
Jun 14 14:28:30 matrixim synapse[12530]:     await self._process_pulled_events(origin, missing_events, backfilled=False)
Jun 14 14:28:30 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/handlers/federation_event.py", line 725, in _process_pulled_events
Jun 14 14:28:30 matrixim synapse[12530]:     await self._process_pulled_event(origin, ev, backfilled=backfilled)
Jun 14 14:28:30 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/handlers/federation_event.py", line 781, in _process_pulled_event
Jun 14 14:28:30 matrixim synapse[12530]:     await self._process_received_pdu(
Jun 14 14:28:30 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/handlers/federation_event.py", line 1112, in _process_received_pdu
Jun 14 14:28:30 matrixim synapse[12530]:     await self._check_for_soft_fail(event, state_ids, origin=origin)
Jun 14 14:28:30 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/handlers/federation_event.py", line 1636, in _check_for_soft_fail
Jun 14 14:28:30 matrixim synapse[12530]:     state_sets_d = await self._state_storage_controller.get_state_groups_ids(
Jun 14 14:28:30 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/controllers/state.py", line 103, in get_state_groups_ids
Jun 14 14:28:30 matrixim synapse[12530]:     event_to_groups = await self.get_state_group_for_events(event_ids)
Jun 14 14:28:30 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/controllers/state.py", line 341, in get_state_group_for_events
Jun 14 14:28:30 matrixim synapse[12530]:     return await self.stores.main._get_state_group_for_events(event_ids)
Jun 14 14:28:30 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:30 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:30 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/databases/main/state.py", line 376, in _get_state_group_for_events
Jun 14 14:28:30 matrixim synapse[12530]:     raise RuntimeError("No state group for unknown or outlier event %s" % e)
Jun 14 14:28:30 matrixim synapse[12530]: RuntimeError: No state group for unknown or outlier event $1610933426688185GBieA:matrix.org
Jun 14 14:28:30 matrixim synapse[12530]: The above exception was the direct cause of the following exception:
Jun 14 14:28:30 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:30 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/federation_server.py", line 1146, in _process_incoming_pdus_in_room_inner
Jun 14 14:28:30 matrixim synapse[12530]:     await self._federation_event_handler.on_receive_pdu(
Jun 14 14:28:30 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/handlers/federation_event.py", line 240, in on_receive_pdu
Jun 14 14:28:30 matrixim synapse[12530]:     raise Exception(
Jun 14 14:28:30 matrixim synapse[12530]: Exception: Error fetching missing prev_events for $1655207512987evDoi:matrix.org: No state group for unknown or outlier event $1610933426688185GBieA:matrix.org
Jun 14 14:28:32 matrixim synapse[12530]: 2022-06-14 14:28:32,672 - synapse.federation.sender.per_destination_queue - 375 - ERROR - federation_transaction_transmission_loop-22 - TX [citadel7.org] Failed to send transaction
Jun 14 14:28:32 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:32 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:32 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:32 matrixim synapse[12530]: StopIteration: []
Jun 14 14:28:32 matrixim synapse[12530]: During handling of the above exception, another exception occurred:
Jun 14 14:28:32 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:32 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 280, in _transaction_transmission_loop
Jun 14 14:28:32 matrixim synapse[12530]:     await self._catch_up_transmission_loop()
Jun 14 14:28:32 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 495, in _catch_up_transmission_loop
Jun 14 14:28:32 matrixim synapse[12530]:     hosts = await self._state.get_hosts_in_room_at_events(
Jun 14 14:28:32 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 187, in get_hosts_in_room_at_events
Jun 14 14:28:32 matrixim synapse[12530]:     entry = await self.resolve_state_groups_for_events(room_id, event_ids)
Jun 14 14:28:32 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/util/metrics.py", line 113, in measured_func
Jun 14 14:28:32 matrixim synapse[12530]:     r = await func(self, *args, **kwargs)
Jun 14 14:28:32 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 352, in resolve_state_groups_for_events
Jun 14 14:28:32 matrixim synapse[12530]:     state_groups = await self._state_storage_controller.get_state_group_for_events(
Jun 14 14:28:32 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/controllers/state.py", line 341, in get_state_group_for_events
Jun 14 14:28:32 matrixim synapse[12530]:     return await self.stores.main._get_state_group_for_events(event_ids)
Jun 14 14:28:32 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:32 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:32 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/databases/main/state.py", line 376, in _get_state_group_for_events
Jun 14 14:28:32 matrixim synapse[12530]:     raise RuntimeError("No state group for unknown or outlier event %s" % e)
Jun 14 14:28:32 matrixim synapse[12530]: RuntimeError: No state group for unknown or outlier event $jbtBiWP_t7JZB2jrnUd_-DMDlhYvcLOMXbuw-RBobjQ
Jun 14 14:28:43 matrixim synapse[12530]: 2022-06-14 14:28:43,451 - synapse.federation.sender.per_destination_queue - 375 - ERROR - federation_transaction_transmission_loop-29 - TX [cybersloth.nl] Failed to send transaction
Jun 14 14:28:43 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:43 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:43 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:43 matrixim synapse[12530]: StopIteration: []
Jun 14 14:28:43 matrixim synapse[12530]: During handling of the above exception, another exception occurred:
Jun 14 14:28:43 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:43 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 280, in _transaction_transmission_loop
Jun 14 14:28:43 matrixim synapse[12530]:     await self._catch_up_transmission_loop()
Jun 14 14:28:43 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 495, in _catch_up_transmission_loop
Jun 14 14:28:43 matrixim synapse[12530]:     hosts = await self._state.get_hosts_in_room_at_events(
Jun 14 14:28:43 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 187, in get_hosts_in_room_at_events
Jun 14 14:28:43 matrixim synapse[12530]:     entry = await self.resolve_state_groups_for_events(room_id, event_ids)
Jun 14 14:28:43 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/util/metrics.py", line 113, in measured_func
Jun 14 14:28:43 matrixim synapse[12530]:     r = await func(self, *args, **kwargs)
Jun 14 14:28:43 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 352, in resolve_state_groups_for_events
Jun 14 14:28:43 matrixim synapse[12530]:     state_groups = await self._state_storage_controller.get_state_group_for_events(
Jun 14 14:28:43 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/controllers/state.py", line 341, in get_state_group_for_events
Jun 14 14:28:43 matrixim synapse[12530]:     return await self.stores.main._get_state_group_for_events(event_ids)
Jun 14 14:28:43 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:43 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:43 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/databases/main/state.py", line 376, in _get_state_group_for_events
Jun 14 14:28:43 matrixim synapse[12530]:     raise RuntimeError("No state group for unknown or outlier event %s" % e)
Jun 14 14:28:43 matrixim synapse[12530]: RuntimeError: No state group for unknown or outlier event $j6Qxtlh-qcXquAz1rwD_9apbSIFn3x8D-9I5zTsJruA
Jun 14 14:28:53 matrixim synapse[12530]: 2022-06-14 14:28:53,430 - synapse.federation.sender.per_destination_queue - 375 - ERROR - federation_transaction_transmission_loop-101 - TX [defos.ee] Failed to send transaction
Jun 14 14:28:53 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:53 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:53 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:53 matrixim synapse[12530]: StopIteration: []
Jun 14 14:28:53 matrixim synapse[12530]: During handling of the above exception, another exception occurred:
Jun 14 14:28:53 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:53 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 280, in _transaction_transmission_loop
Jun 14 14:28:53 matrixim synapse[12530]:     await self._catch_up_transmission_loop()
Jun 14 14:28:53 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 495, in _catch_up_transmission_loop
Jun 14 14:28:53 matrixim synapse[12530]:     hosts = await self._state.get_hosts_in_room_at_events(
Jun 14 14:28:53 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 187, in get_hosts_in_room_at_events
Jun 14 14:28:53 matrixim synapse[12530]:     entry = await self.resolve_state_groups_for_events(room_id, event_ids)
Jun 14 14:28:53 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/util/metrics.py", line 113, in measured_func
Jun 14 14:28:53 matrixim synapse[12530]:     r = await func(self, *args, **kwargs)
Jun 14 14:28:53 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 352, in resolve_state_groups_for_events
Jun 14 14:28:53 matrixim synapse[12530]:     state_groups = await self._state_storage_controller.get_state_group_for_events(
Jun 14 14:28:53 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/controllers/state.py", line 341, in get_state_group_for_events
Jun 14 14:28:53 matrixim synapse[12530]:     return await self.stores.main._get_state_group_for_events(event_ids)
Jun 14 14:28:53 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:53 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:53 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/databases/main/state.py", line 376, in _get_state_group_for_events
Jun 14 14:28:53 matrixim synapse[12530]:     raise RuntimeError("No state group for unknown or outlier event %s" % e)
Jun 14 14:28:53 matrixim synapse[12530]: RuntimeError: No state group for unknown or outlier event $jbtBiWP_t7JZB2jrnUd_-DMDlhYvcLOMXbuw-RBobjQ
Jun 14 14:28:54 matrixim synapse[12530]: 2022-06-14 14:28:54,395 - synapse.federation.sender.per_destination_queue - 375 - ERROR - federation_transaction_transmission_loop-119 - TX [nth.io] Failed to send transaction
Jun 14 14:28:54 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:54 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:54 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:54 matrixim synapse[12530]: StopIteration: []
Jun 14 14:28:54 matrixim synapse[12530]: During handling of the above exception, another exception occurred:
Jun 14 14:28:54 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:54 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 280, in _transaction_transmission_loop
Jun 14 14:28:54 matrixim synapse[12530]:     await self._catch_up_transmission_loop()
Jun 14 14:28:54 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 495, in _catch_up_transmission_loop
Jun 14 14:28:54 matrixim synapse[12530]:     hosts = await self._state.get_hosts_in_room_at_events(
Jun 14 14:28:54 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 187, in get_hosts_in_room_at_events
Jun 14 14:28:54 matrixim synapse[12530]:     entry = await self.resolve_state_groups_for_events(room_id, event_ids)
Jun 14 14:28:54 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/util/metrics.py", line 113, in measured_func
Jun 14 14:28:54 matrixim synapse[12530]:     r = await func(self, *args, **kwargs)
Jun 14 14:28:54 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 352, in resolve_state_groups_for_events
Jun 14 14:28:54 matrixim synapse[12530]:     state_groups = await self._state_storage_controller.get_state_group_for_events(
Jun 14 14:28:54 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/controllers/state.py", line 341, in get_state_group_for_events
Jun 14 14:28:54 matrixim synapse[12530]:     return await self.stores.main._get_state_group_for_events(event_ids)
Jun 14 14:28:54 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:54 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:54 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/databases/main/state.py", line 376, in _get_state_group_for_events
Jun 14 14:28:54 matrixim synapse[12530]:     raise RuntimeError("No state group for unknown or outlier event %s" % e)
Jun 14 14:28:54 matrixim synapse[12530]: RuntimeError: No state group for unknown or outlier event $jbtBiWP_t7JZB2jrnUd_-DMDlhYvcLOMXbuw-RBobjQ
Jun 14 14:28:56 matrixim synapse[12530]: 2022-06-14 14:28:56,758 - synapse.federation.sender.per_destination_queue - 375 - ERROR - federation_transaction_transmission_loop-134 - TX [delta0189.xyz] Failed to send transaction
Jun 14 14:28:56 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:56 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:56 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:56 matrixim synapse[12530]: StopIteration: []
Jun 14 14:28:56 matrixim synapse[12530]: During handling of the above exception, another exception occurred:
Jun 14 14:28:56 matrixim synapse[12530]: Traceback (most recent call last):
Jun 14 14:28:56 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 280, in _transaction_transmission_loop
Jun 14 14:28:56 matrixim synapse[12530]:     await self._catch_up_transmission_loop()
Jun 14 14:28:56 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/federation/sender/per_destination_queue.py", line 495, in _catch_up_transmission_loop
Jun 14 14:28:56 matrixim synapse[12530]:     hosts = await self._state.get_hosts_in_room_at_events(
Jun 14 14:28:56 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 187, in get_hosts_in_room_at_events
Jun 14 14:28:56 matrixim synapse[12530]:     entry = await self.resolve_state_groups_for_events(room_id, event_ids)
Jun 14 14:28:56 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/util/metrics.py", line 113, in measured_func
Jun 14 14:28:56 matrixim synapse[12530]:     r = await func(self, *args, **kwargs)
Jun 14 14:28:56 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/state/__init__.py", line 352, in resolve_state_groups_for_events
Jun 14 14:28:56 matrixim synapse[12530]:     state_groups = await self._state_storage_controller.get_state_group_for_events(
Jun 14 14:28:56 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/controllers/state.py", line 341, in get_state_group_for_events
Jun 14 14:28:56 matrixim synapse[12530]:     return await self.stores.main._get_state_group_for_events(event_ids)
Jun 14 14:28:56 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/twisted/internet/defer.py", line 1661, in _inlineCallbacks
Jun 14 14:28:56 matrixim synapse[12530]:     result = current_context.run(gen.send, result)
Jun 14 14:28:56 matrixim synapse[12530]:   File "/usr/lib/python3.10/site-packages/synapse/storage/databases/main/state.py", line 376, in _get_state_group_for_events
Jun 14 14:28:56 matrixim synapse[12530]:     raise RuntimeError("No state group for unknown or outlier event %s" % e)
Jun 14 14:28:56 matrixim synapse[12530]: RuntimeError: No state group for unknown or outlier event $jbtBiWP_t7JZB2jrnUd_-DMDlhYvcLOMXbuw-RBobjQ