53232e6df5
Fill in for remote invites (out of band, outlier membership)
2024-08-12 18:14:02 -05:00
f069659343
Fix lints
2024-08-12 15:49:40 -05:00
552f8f496d
Update descriptions
2024-08-12 15:43:06 -05:00
0af3b4822c
Refactor to sliding_sync_membership_snapshots
2024-08-12 15:10:44 -05:00
ed47a7eff5
Fix bumping when events are persisted out of order
2024-08-12 11:27:17 -05:00
3367422fd3
Need to fix upsert
2024-08-08 18:23:50 -05:00
ca909013c8
Fill in stream_ordering/bump_stamp for any event being persisted
2024-08-08 17:49:15 -05:00
cc2d2b6b9f
Fill in stream_ordering/bump_stamp when we add current state to the joined rooms table
2024-08-08 15:41:55 -05:00
bc3796d333
Fix some lints
2024-08-07 20:49:46 -05:00
5cf3ad3d7f
Handle server left room
2024-08-07 20:47:13 -05:00
bf78692ba0
Handle to_delete
2024-08-07 20:09:53 -05:00
a1aaa47dad
Add more tests
2024-08-07 19:58:51 -05:00
c590474757
Test non-joins
2024-08-07 19:24:58 -05:00
5b1053f23e
Better test assertions
2024-08-07 19:07:43 -05:00
68a3daf605
Fix comparison and insert
2024-08-07 18:10:24 -05:00
61cea4e9b7
Closer to right
2024-08-07 18:07:53 -05:00
87d95615d4
Change to updating the latest membership in the room
2024-08-07 16:37:17 -05:00
cb335805d4
Server left room test
2024-08-07 10:46:34 -05:00
2f3bd27284
Test is running
2024-08-06 16:50:14 -05:00
f96d0c36a3
Special treatment for boolean columns
...
See https://github.com/element-hq/synapse/blob/1dfa59b238cee0dc62163588cc9481896c288979/docs/development/database_schema.md#boolean-columns
2024-08-06 15:30:51 -05:00
1a251d5211
Fill in sliding_sync_non_join_memberships when current state changes
2024-08-06 15:18:34 -05:00
2b5f07d714
Start of updating sliding_sync_joined_rooms
2024-08-05 22:34:21 -05:00
ad1c887b4c
Merge branch 'develop' into madlittlemods/sliding-sync-pre-populate-room-meta-data
2024-08-05 18:19:17 -05:00
e3db7b2d81
Sliding Sync: Easier to understand timeline assertions in tests ( #17511 )
...
Added `_assertTimelineEqual(...)` because I got fed up trying to
understand the crazy diffs from the standard
`self.assertEqual(...)`/`self.assertListEqual(...)`
Before:
```
[FAIL]
Traceback (most recent call last):
File "/home/eric/Documents/github/element/synapse/tests/rest/client/sliding_sync/test_rooms_timeline.py", line 103, in test_rooms_limited_initial_sync
self.assertListEqual(
File "/usr/lib/python3.12/unittest/case.py", line 1091, in assertListEqual
self.assertSequenceEqual(list1, list2, msg, seq_type=list)
File "/usr/lib/python3.12/unittest/case.py", line 1073, in assertSequenceEqual
self.fail(msg)
twisted.trial.unittest.FailTest: Lists differ: ['$4QcmnzhdazSnDYcYSZCS_6-MWSzM_dN3RC7TRvW0w[95 chars]isM'] != ['$8N1XJ7e-3K_wxAanLVD3v8KQ96_B5Xj4huGkgy4N4[95 chars]nnU']
First differing element 0:
'$4QcmnzhdazSnDYcYSZCS_6-MWSzM_dN3RC7TRvW0wWA'
'$8N1XJ7e-3K_wxAanLVD3v8KQ96_B5Xj4huGkgy4N4-E'
- ['$4QcmnzhdazSnDYcYSZCS_6-MWSzM_dN3RC7TRvW0wWA',
- '$8N1XJ7e-3K_wxAanLVD3v8KQ96_B5Xj4huGkgy4N4-E',
? ^
+ ['$8N1XJ7e-3K_wxAanLVD3v8KQ96_B5Xj4huGkgy4N4-E',
? ^
- '$q4PRxQ_pBZkQI1keYuZPTtExQ23DqpUI3-Lxwfj_isM']
+ '$4QcmnzhdazSnDYcYSZCS_6-MWSzM_dN3RC7TRvW0wWA',
+ '$j3Xj-t2F1wH9kUHsI8X5yqS7hkdSyN2owaArfvk8nnU']
```
After:
```
[FAIL]
Traceback (most recent call last):
File "/home/eric/Documents/github/element/synapse/tests/rest/client/sliding_sync/test_rooms_timeline.py", line 178, in test_rooms_limited_initial_sync
self._assertTimelineEqual(
File "/home/eric/Documents/github/element/synapse/tests/rest/client/sliding_sync/test_rooms_timeline.py", line 110, in _assertTimelineEqual
self._assertListEqual(
File "/home/eric/Documents/github/element/synapse/tests/rest/client/sliding_sync/test_rooms_timeline.py", line 79, in _assertListEqual
self.fail(f"{diff_message}\n{message}")
twisted.trial.unittest.FailTest: Items must
Expected items to be in actual ('?' = missing expected items):
[
(10, master) $w-BoqW1PQQFU4TzVJW5OIelugxh0mY12wrfw6mbC6D4 (m.room.message) activity4
(11, master) $sSidTZf1EOQmCVDU4mrH_1-bopMQhwcDUO2IhoemR6M (m.room.message) activity5
? (12, master) $bgOcc3D-2QSkbk4aBxKVyOOQJGs7ZuncRJwG3cEANZg (m.room.member, @user1:test) join
]
Actual ('+' = found expected items):
[
+ (11, master) $sSidTZf1EOQmCVDU4mrH_1-bopMQhwcDUO2IhoemR6M (m.room.message) activity5
+ (10, master) $w-BoqW1PQQFU4TzVJW5OIelugxh0mY12wrfw6mbC6D4 (m.room.message) activity4
(9, master) $FmCNyc11YeFwiJ4an7_q6H0LCCjQOKd6UCr5VKeXXUw (m.room.message, None) activity3
]
```
2024-08-05 13:20:15 -05:00
8392d6ac3b
Use foreign keys
2024-07-31 19:00:55 -05:00
e7e9cb289d
Add changelog
2024-07-31 18:43:50 -05:00
d26ac746d4
Start thinking about schemas
2024-07-31 18:40:23 -05:00
2b620e0a15
Sliding Sync: Add typing notification extension (MSC3961) ( #17505 )
...
[MSC3961](https://github.com/matrix-org/matrix-spec-proposals/pull/3961 ): Sliding Sync Extension: Typing Notifications
Based on
[MSC3575](https://github.com/matrix-org/matrix-spec-proposals/pull/3575 ):
Sliding Sync
2024-07-31 13:20:23 -05:00
39731bb205
Sliding Sync: Split and move tests ( #17504 )
...
Split and move Sliding Sync tests so we have some more sane test file
sizes
2024-07-31 12:20:46 -05:00
1d6186265a
Sliding Sync: Fix limited response description (make accurate) ( #17507 )
2024-07-31 11:47:26 -05:00
46de0ee16b
Sliding Sync: Update filters to be robust against remote invite rooms ( #17450 )
...
Update `filters.is_encrypted` and `filters.types`/`filters.not_types` to
be robust when dealing with remote invite rooms in Sliding Sync.
Part of
[MSC3575](https://github.com/matrix-org/matrix-spec-proposals/pull/3575 ):
Sliding Sync
Follow-up to https://github.com/element-hq/synapse/pull/17434
We now take into account current state, fallback to stripped state
for invite/knock rooms, then historical state. If we can't determine
the info needed to filter a room (either from state or stripped state),
it is filtered out.
2024-07-30 13:20:29 -05:00
b221f0b84b
Sliding Sync: Add receipts extension (MSC3960) ( #17489 )
...
[MSC3960](https://github.com/matrix-org/matrix-spec-proposals/pull/3960 ): Receipts extension
Based on
[MSC3575](https://github.com/matrix-org/matrix-spec-proposals/pull/3575 ):
Sliding Sync
2024-07-30 12:49:55 -05:00
b2c55bd049
Merge branch 'master' into develop
2024-07-30 18:09:05 +01:00
ed583d9c81
Merge branch 'release-v1.112'
2024-07-30 18:07:35 +01:00
f76dc9923c
Bump types-setuptools from 70.1.0.20240627 to 71.1.0.20240726 ( #17497 )
...
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-30 17:33:43 +01:00
7e997fb8b1
Bump types-pyopenssl from 24.1.0.20240425 to 24.1.0.20240722 ( #17496 )
...
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-30 17:33:18 +01:00
dbc2290cbe
Bump bcrypt from 4.1.3 to 4.2.0 ( #17495 )
...
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-30 17:32:49 +01:00
2f6b86e79a
Bump serde_json from 1.0.120 to 1.0.121 ( #17493 )
...
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-30 17:32:16 +01:00
37f9876ccf
1.112.0
2024-07-30 17:24:09 +01:00
8b449a8ce6
Upgrade locked dependency on Twisted to 24.7.0rc1. ( #17502 )
...
I also update the tests and HTTP Proxy code to fix it for this new
Twisted release.
Pulls in fix for
https://github.com/twisted/twisted/security/advisories/GHSA-c8m8-j448-xjx7
Signed-off-by: Olivier 'reivilibre <oliverw@matrix.org >
2024-07-30 17:14:14 +01:00
53db8a914e
Merge branch 'master' into develop
2024-07-30 17:10:46 +01:00
e4868f8a1e
Add bold emphasis to some parts of the changelog
2024-07-30 16:23:58 +01:00
dcad81082c
1.111.1
2024-07-30 16:16:35 +01:00
c56b070e6f
Upgrade locked dependency on Twisted to 24.7.0rc1. ( #17502 )
...
I also update the tests and HTTP Proxy code to fix it for this new
Twisted release.
Pulls in fix for
https://github.com/twisted/twisted/security/advisories/GHSA-c8m8-j448-xjx7
Signed-off-by: Olivier 'reivilibre <oliverw@matrix.org >
2024-07-30 15:23:23 +01:00
be726724a8
Bump ruff from 0.5.4 to 0.5.5 ( #17494 )
...
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-30 11:44:54 +01:00
62ae56a4ac
Add some more opentracing to sliding sync ( #17501 )
...
This will make it easier to see what it is doing in jaeger.
2024-07-30 10:54:11 +01:00
808dab0699
Fix failures property in /keys/query ( #17499 )
...
Fixes: https://github.com/element-hq/synapse/issues/17498
Fixes: https://github.com/element-hq/element-web/issues/27867
2024-07-30 09:51:24 +01:00
34306be5aa
Only send rooms with updates down sliding sync ( #17479 )
...
Rather than always including all rooms in range.
Also adds a pre-filter to rooms that checks the stream change cache to
see if anything might have happened.
Based on #17447
---------
Co-authored-by: Eric Eastwood <eric.eastwood@beta.gouv.fr >
2024-07-30 09:30:44 +01:00
be4a16ff44
Sliding Sync: Track whether we have sent rooms down to clients ( #17447 )
...
The basic idea is that we introduce a new token for a sliding sync
connection, which stores the mapping of room to room "status" (i.e. have
we sent the room down?). This token allows us to handle duplicate
requests properly. In future it can be used to store more
"per-connection" information safely.
In future this should be migrated into the DB, so its important that we
try to reduce the number of syncs where we need to update the
per-connection information. In this PoC this only happens when we: a)
send down a set of room for the first time, or b) we have previously
sent down a room and there are updates but we are not sending the room
down the sync (due to not falling in a list range)
Co-authored-by: Eric Eastwood <eric.eastwood@beta.gouv.fr >
2024-07-29 22:45:48 +01:00
568051c0f0
Refactor Sliding Sync tests to better utilize the SlidingSyncBase.do_sync(...) (pt. 2) ( #17482 )
...
`SlidingSyncBase.do_sync()` for tests was first introduced in
https://github.com/element-hq/synapse/pull/17452
Part 1: https://github.com/element-hq/synapse/pull/17481
2024-07-25 11:01:47 -05:00
Eric Eastwood