041acdf985
Working second test although it's a bit pointless testing whether opentelemetry works
2022-07-29 22:18:59 -05:00
d29a4af916
Move to start_active_span
2022-07-29 22:08:11 -05:00
7c135b93bd
Easier to follow local vs remote span tracing
...
The `incoming-federation-request` vs `process-federation_request` was first introduced in
https://github.com/matrix-org/synapse/pull/11870
- Span for remote trace: `incoming-federation-request`
- `child_of` reference: `origin_span_context`
- `follows_from` reference: `servlet_span`
- Span for local trace: `process-federation-request`
- `child_of` reference: `servlet_span` (by the nature of it being active)
- `follows_from` reference: `incoming-federation-request`
2022-07-29 21:49:47 -05:00
786dd9b4b1
Explain weird function
2022-07-29 17:06:43 -05:00
19d20b50e8
Record exception
2022-07-29 16:54:26 -05:00
2011ac2100
Fix using wrong type of context (Context vs SpanContext)
...
Fix error:
```
AttributeError: 'SpanContext' object has no attribute 'get'
```
`Context`:
```
{'current-span-1a226c96-a5db-4412-bcaa-1fdd34213c5c': _Span(name="sendToDevice", context=SpanContext(trace_id=0x5d2dcc3fdc8205046d60a5cd18672ac6, span_id=0x715c736ff5f4d208, trace_flags=0x01, trace_state=[], is_remote=False))}
```
`SpanContext`:
```
SpanContext(trace_id=0xf7cd9d058b7b76f364bdd649c4ba7b8a, span_id=0x287ce71bac31bfc4, trace_flags=0x01, trace_state=[], is_remote=False)
```
2022-07-29 00:50:37 -05:00
1d208fa17e
Fix invalid attribute type
...
```
Invalid type StreamToken for attribute value. Expected one of ['bool', 'str', 'bytes', 'int', 'float'] or a sequence of those types
```
Had to add a few more logs to find this instance since the warning doens't give much info where I am setting this invalid attribute.
This was good enough to find it in the code.
```
BoundedAttributes __setitem__ key=since_token value=StreamToken(room_key=RoomStreamToken(topological=None, stream=1787, instance_map=frozendict.frozendict({})), presence_key=481272, typing_key=0, receipt_key=340, account_data_key=1233, push_rules_key=8, to_device_key=57, device_list_key=199, groups_key=0)
BoundedAttributes __setitem__ key=now_token value=StreamToken(room_key=RoomStreamToken(topological=None, stream=1787, instance_map=frozendict.frozendict({})), presence_key=481287, typing_key=0, receipt_key=340, account_data_key=1233, push_rules_key=8, to_device_key=57, device_list_key=199, groups_key=0)
BoundedAttributes __setitem__ key=token value=StreamToken(room_key=RoomStreamToken(topological=None, stream=1787, instance_map=frozendict.frozendict({})), presence_key=481291, typing_key=0, receipt_key=340, account_data_key=1237, push_rules_key=8, to_device_key=57, device_list_key=199, groups_key=0)
```
2022-07-29 00:25:03 -05:00
1b0840e3aa
Fix some lints
2022-07-28 19:43:43 -05:00
3a259960fb
Fixup some todos
2022-07-28 00:18:08 -05:00
f6c3b22a21
Fix some lints
2022-07-27 16:49:00 -05:00
9e1de8696c
We use the config for the Jaeger exporter now
2022-07-27 12:52:51 -05:00
0d7a2b93cf
Revert changes to Sentry scopes (not OTEL)
...
See https://github.com/matrix-org/synapse/pull/13400#discussion_r931325627
2022-07-27 12:52:10 -05:00
242817213e
Export to Jaeger (things are showing up)
2022-07-27 02:36:10 -05:00
6406fd5d84
Server running
2022-07-27 01:12:48 -05:00
6984cefa79
Progress towards OTEL
2022-07-27 00:55:43 -05:00
2fe6911957
Some shim and some new
2022-07-26 21:53:11 -05:00
0cc610ecbe
Migrate to OpenTelemetry tracing
...
See https://github.com/matrix-org/synapse/issues/11850
2022-07-26 18:44:21 -05:00
357561c1a2
Backfill remote event fetched by MSC3030 so we can paginate from it later ( #13205 )
...
Depends on https://github.com/matrix-org/synapse/pull/13320
Complement tests: https://github.com/matrix-org/complement/pull/406
We could use the same method to backfill for `/context` as well in the future, see https://github.com/matrix-org/synapse/issues/3848
2022-07-22 16:00:11 -05:00
c7c84b81e3
Update config_documentation.md ( #13364 )
...
"changed in" goes before the example
2022-07-22 13:50:20 +01:00
0fa41a7b17
Update locked frozendict version to 2.3.3 ( #13352 )
...
frozendict 2.3.3 includes fixes for memory leaks that get triggered during `/sync`.
2022-07-22 10:26:09 +01:00
158782c3ce
Skip soft fail checks for rooms with partial state ( #13354 )
...
When a room has the partial state flag, we may not have an accurate
`m.room.member` event for event senders in the room's current state, and
so cannot perform soft fail checks correctly. Skip the soft fail check
entirely in this case.
As an alternative, we could block until we have full state, but that
would prevent us from receiving incoming events over federation, which
is undesirable.
Signed-off-by: Sean Quah <seanq@matrix.org >
2022-07-22 10:13:01 +01:00
86e366a46e
Remove old empty/redundant slaved stores. ( #13349 )
2022-07-21 17:56:45 +00:00
0b87eb8e0c
Make DictionaryCache have better expiry properties ( #13292 )
2022-07-21 17:13:44 +01:00
13341dde5a
Don't hold onto full state in state cache ( #13324 )
2022-07-21 16:02:02 +01:00
10e4093839
Call out buildkit is required when building test docker images ( #13338 )
...
Co-authored-by: David Robertson <davidr@element.io >
2022-07-21 14:29:58 +02:00
34949ead1f
Track DB txn times w/ two counters, not histogram ( #13342 )
2022-07-21 13:23:05 +01:00
50122754c8
Add missing types to opentracing. ( #13345 )
...
After this change `synapse.logging` is fully typed.
2022-07-21 12:01:52 +00:00
190f49d8ab
Use cache store remove base slaved ( #13329 )
...
This comes from two identical definitions in each of the base stores, and means the base slaved store is now empty and can be removed.
2022-07-21 11:51:30 +01:00
4f57ef0b18
Merge branch 'master' into develop
2022-07-21 11:27:08 +01:00
b909d5327b
Document rc_invites.per_issuer, added in v1.63.
...
Resolves #13330 .
Missed in #13125 .
Signed-off-by: David Teller <davidt@element.io >
2022-07-21 11:26:34 +01:00
0f971ca68e
Update get_pdu to return the original, pristine EventBase ( #13320 )
...
Update `get_pdu` to return the untouched, pristine `EventBase` as it was originally seen over federation (no metadata added). Previously, we returned the same `event` reference that we stored in the cache which downstream code modified in place and added metadata like setting it as an `outlier` and essentially poisoned our cache. Now we always return a copy of the `event` so the original can stay pristine in our cache and re-used for the next cache call.
Split out from https://github.com/matrix-org/synapse/pull/13205
As discussed at:
- https://github.com/matrix-org/synapse/pull/13205#discussion_r918365746
- https://github.com/matrix-org/synapse/pull/13205#discussion_r918366125
Related to https://github.com/matrix-org/synapse/issues/12584 . This PR doesn't fix that issue because it hits [`get_event` which exists from the local database before it tries to `get_pdu`](https://github.com/matrix-org/synapse/blob/7864f33e286dec22368dc0b11c06eebb1462a51e/synapse/federation/federation_client.py#L581-L594 ).
2022-07-20 15:58:51 -05:00
a1b62af2af
Validate federation destinations and log an error if server name is invalid. ( #13318 )
2022-07-20 11:17:26 -07:00
d3995049a8
Merge remote-tracking branch 'origin/master' into develop
2022-07-20 14:59:43 +01:00
93740cae57
1.63.1
2022-07-20 13:37:00 +01:00
b4ae3b0d44
Don't include appservice users when calculating push rules ( #13332 )
...
This can cause a lot of extra load on servers with lots of appservice users. Introduced in #13078
2022-07-20 12:06:13 +01:00
172ce29b14
Fix spurious warning when fetching state after a missing prev event ( #13258 )
2022-07-19 19:15:54 +01:00
a6895dd576
Add type annotations to trace decorator. ( #13328 )
...
Functions that are decorated with `trace` are now properly typed
and the type hints for them are fixed.
2022-07-19 14:14:30 -04:00
47822fd2e8
Merge branch 'master' into develop
2022-07-19 16:14:02 +02:00
de70b25e84
Reduce memory usage of state group cache ( #13323 )
2022-07-19 14:40:37 +01:00
1efe6b8c41
Stop building Ubuntu 21.10 (Impish Indri) which is end of life. ( #13326 )
2022-07-19 09:08:46 -04:00
6fccd72f42
Improve precision on validation improvements
2022-07-19 14:53:12 +02:00
097afd0e0b
1.63.0
2022-07-19 14:43:28 +02:00
6faaf76a32
Remove 'anonymised' from the phone home stats documentation ( #13321 )
2022-07-19 12:38:29 +00:00
84c5e6b1fd
Bash script for creating multiple stream writers ( #13271 )
...
Add another bash script to the contrib directory. It creates multiple stream writers and also prints out the example configuration for homeserver.yaml.
Signed-off-by: Ville Petteri Huh.
2022-07-19 12:37:20 +00:00
87a917e8c8
Add notes when config options were changed to config documentation ( #13314 )
...
Signed-off-by: Jörg Behrmann <behrmann@physik.fu-berlin.de >
2022-07-19 12:36:29 +00:00
b977867358
Rate limit joins per-room ( #13276 )
2022-07-19 11:45:17 +00:00
2ee0b6ef4b
Safe async event cache ( #13308 )
...
Fix race conditions in the async cache invalidation logic, by separating
the async & local invalidation calls and ensuring any async call i
executed first.
Signed off by Nick @ Beeper (@Fizzadar).
2022-07-19 11:25:29 +00:00
7864f33e28
Increase batch size of bulk_get_push_rules and _get_joined_profiles_from_event_ids. ( #13300 )
2022-07-18 13:15:23 -07:00
15edf23626
Improve performance of query _get_subset_users_in_room_with_profiles ( #13299 )
2022-07-18 12:35:45 -07:00
5526f9fc4f
Fix overcounting of pushers when they are replaced ( #13296 )
...
Signed-off-by: Sean Quah <seanq@matrix.org >
2022-07-18 17:39:39 +01:00
Eric Eastwood