kaslo/synapse
1
0
Fork 0
Code Wiki Activity
24,214 Commits 1,047 Branches 805 Tags
e2dca5d37e6d77dc1b7aa0d28a0a6a697b5d69e4
Commit Graph

24214 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Eric Eastwood
e2dca5d37e Merge branch 'develop' into madlittlemods/sliding-sync-faster-background-updates 
Conflicts:
	synapse/storage/databases/main/events_bg_updates.py
 2024-09-10 12:59:29 -05:00
Travis Ralston
a7fcac5648 Enable guest access on new media endpoints, per MSC4189 (#17675) 2024-09-10 18:29:24 +01:00
V02460
e06e3c4004 Add config option turn_shared_secret_path (#17690) 
Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
 2024-09-10 17:27:46 +00:00
dependabot[bot]
60441059a3 Bump anyhow from 1.0.86 to 1.0.87 (#17685) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-09-10 18:05:31 +01:00
Jeremy Wright
1b197752b6 Fix minor misspelling in README.rst. (#17664) 2024-09-10 17:33:25 +01:00
dependabot[bot]
598a83d005 Bump cryptography from 43.0.0 to 43.0.1 (#17689) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-09-10 17:32:17 +01:00
dependabot[bot]
be603de2cb Bump serde_json from 1.0.127 to 1.0.128 (#17687) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-09-10 17:31:34 +01:00
dependabot[bot]
62523571ae Bump serde from 1.0.209 to 1.0.210 (#17686) 2024-09-10 17:30:37 +01:00
Devon Hudson
5562a89168 Update changelog v1.115.0rc1 2024-09-10 08:48:41 -06:00
Devon Hudson
59bcbcec0a 1.115.0rc1 2024-09-10 08:42:01 -06:00
dependabot[bot]
d8b926d323 Bump idna from 3.7 to 3.8 (#17682) 2024-09-10 10:34:54 +01:00
dependabot[bot]
2efed1d4fb Bump types-setuptools from 71.1.0.20240818 to 74.1.0.20240907 (#17681) 2024-09-10 10:34:45 +01:00
dependabot[bot]
cd24bc2f36 Bump ruff from 0.6.2 to 0.6.4 (#17680) 2024-09-10 10:34:34 +01:00
dependabot[bot]
a193d4a1b5 Bump authlib from 1.3.1 to 1.3.2 (#17679) 2024-09-10 10:34:26 +01:00
Erik Johnston
b3047f3f17 Sliding sync: various fixups to the sliding sync joined room background job (#17673) 
Follow-up to #17652, https://github.com/element-hq/synapse/pull/17641,
https://github.com/element-hq/synapse/pull/17634,
https://github.com/element-hq/synapse/pull/17631 and
https://github.com/element-hq/synapse/pull/17632 to fix-up
https://github.com/element-hq/synapse/pull/17512
 2024-09-10 10:22:46 +01:00
Erik Johnston
9689ac3294 Sliding Sync: Look for bump _stamp in the room timeline (#17684) 
This allows us to skip checking the database a lot of the time.

---------

Co-authored-by: Eric Eastwood <eric.eastwood@beta.gouv.fr>
 2024-09-10 10:20:30 +01:00
Erik Johnston
588e5b521d Sliding Sync: Retrieve fewer events from DB in sync (#17688) 
When using timeline limit of 1 we end up fetching 2 events from the DB
purely to tell if the response was "limited" or not. Lets not do that.
 2024-09-10 09:52:42 +01:00
Eric Eastwood
ca4afad068 Be more precise 2024-09-09 23:42:22 -05:00
Eric Eastwood
a2da5376a3 Add changelog 2024-09-09 23:38:36 -05:00
Eric Eastwood
f045574426 Better comments 2024-09-09 23:25:08 -05:00
Eric Eastwood
1688212268 Uncomment and remove todo 2024-09-09 23:14:38 -05:00
Eric Eastwood
815ef2fb99 Read from the room_stats_state table 2024-09-09 23:10:25 -05:00
Eric Eastwood
a4cc5eb02c Get snapshots info concurrently 2024-09-09 22:53:52 -05:00
Eric Eastwood
1078163731 Make sure re-use doesn't blow up 2024-09-09 21:31:44 -05:00
Eric Eastwood
2c2146d167 Only re-use for join memberships 2024-09-09 20:00:42 -05:00
Eric Eastwood
90371d48af Sort by event_stream_ordering so we can re-use snapshots along the way 2024-09-09 19:31:47 -05:00
Eric Eastwood
836bcaefe0 Fix nothing being upserted 2024-09-09 19:13:28 -05:00
Eric Eastwood
f74106bc71 Implement insertion_value_names/insertion_value_values for simple_upsert_many_txn(...) 2024-09-09 18:44:15 -05:00
Eric Eastwood
ef2f5532c8 Merge branch 'develop' into madlittlemods/sliding-sync-faster-background-updates 
Conflicts:
	synapse/storage/databases/main/events_bg_updates.py
 2024-09-09 17:58:54 -05:00
Eric Eastwood
515c1cc0a1 Sliding Sync: Add comment to explain extra case where you can be invited -> banned -> unbanned (#17654) 
Add comment to explain extra case where you can be
invited -> banned -> unbanned and we want to be able
to find the invite event.

Follow-up to https://github.com/element-hq/synapse/pull/17636#discussion_r1738993330
 2024-09-09 17:55:59 -05:00
Eric Eastwood
e1ed959a68 Sliding Sync: Get bump_stamp from new sliding sync tables because it's faster (#17658) 
Get `bump_stamp` from [new sliding sync
tables](https://github.com/element-hq/synapse/pull/17512) which should
be faster (performance) than flipping through the latest events in the
room.
 2024-09-09 16:41:25 +01:00
Erik Johnston
5c229415c4 Revert "Look for bump stamp in the room timeline" 
This reverts commit a3c49565ff.
 2024-09-09 11:58:50 +01:00
Erik Johnston
a3c49565ff Look for bump stamp in the room timeline 
This allows us to skip checking the database a lot of the time.
 2024-09-09 11:58:18 +01:00
Eric Eastwood
5389374ef8 Sliding Sync: Speed up incremental sync by avoiding extra work (#17665) 
Speed up incremental sync by avoiding extra work. We first look at the
state delta changes and only fetch and calculate further derived things
if they have changed.
 2024-09-09 10:36:22 +01:00
Eric Eastwood
333b4721be TODO and asserts 2024-09-06 15:36:28 -05:00
Erik Johnston
e5d07bb083 Fix bump stamp for non-joined rooms (#17674) 
We should only look for bump stamps in joined rooms, otherwise we should
just use the membership stream ordering.
 2024-09-06 11:44:37 +01:00
Erik Johnston
a708e1afd0 Small performance improvements for sliding sync (#17672) 
A couple of small performance improvements for sliding sync.
 2024-09-06 11:44:13 +01:00
Erik Johnston
786de8570b Speed up fetching partial-state rooms on sliding sync (#17666) 
Instead of having a large cache of `room_id -> bool` about whether a
room is partially stated, replace with a "fetch rooms the user is which
are partially-stated". This is a lot faster as the set of partially
stated rooms at any point across the whole server is small, and so such
a query is fast.

The main issue with the bulk cache lookup is the CPU time looking all
the rooms up in the cache.
 2024-09-06 11:12:54 +01:00
Erik Johnston
d5accec2e5 Speed up sliding sync by avoiding copies (#17670) 
We ended up spending ~10% CPU creating a new dictionary and
`_RoomMembershipForUser`, so let's avoid creating new dicts and copying
by returning `newly_joined`, `newly_left` and `is_dm` as sets directly.

---------

Co-authored-by: Eric Eastwood <eric.eastwood@beta.gouv.fr>
 2024-09-06 11:12:29 +01:00
Eric Eastwood
27caa47c50 Work on snapshots background update 2024-09-06 02:34:07 -05:00
Eric Eastwood
ce7e1b4e67 Look for previous snapshot 2024-09-06 01:48:39 -05:00
Eric Eastwood
b4fcbc9686 concurrently_execute inserting 2024-09-06 00:48:48 -05:00
Eric Eastwood
5894fc200c concurrently_execute data fetching 2024-09-06 00:33:55 -05:00
Eric Eastwood
944661a949 Pull from room_stats_state 2024-09-06 00:24:26 -05:00
Johannes Marbach
de3363ef58 Stabilise MSC4156: server_name -> via (#17650) 2024-09-05 17:07:39 +01:00
Erik Johnston
6b770d8bfc Revert "Fix bump stamp for non-joined rooms" 
This reverts commit f73c844403.
 2024-09-05 15:43:37 +01:00
Erik Johnston
f73c844403 Fix bump stamp for non-joined rooms 
We should only look for bump stamps in joined rooms, otherwise we should
just use the membership stream ordering.
 2024-09-05 15:42:49 +01:00
Erik Johnston
b09bcf16d9 Fix background update to handle invalid events (#17641) 
Follow-up to #17634, https://github.com/element-hq/synapse/pull/17631
and https://github.com/element-hq/synapse/pull/17632 to fix-up
https://github.com/element-hq/synapse/pull/17512
 2024-09-05 14:15:04 +01:00
Eric Eastwood
b054690c8c Sliding Sync: Prevent duplicate tags being added to traces (#17655) 
Prevent duplicate tags being added to traces.

Noticed because we see these warnings in Jaeger:

<img width="462" alt="Screenshot 2024-09-03 at 2 34 05 PM"
src="https://github.com/user-attachments/assets/6fac12ed-0074-435b-9451-eccde7e7012a">
 2024-09-05 10:05:01 +01:00
Erik Johnston
dce38f3faf Fix sliding sync on workers (#17649) 
Broke in #17630

---------

Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
 2024-09-04 10:52:46 +01:00