kaslo/synapse
1
0
Fork 0
Code Wiki Activity
24,160 Commits 1,047 Branches 805 Tags
9c3b906b3aa13d83f3dc5eb080dc7e77d6d00511
Commit Graph

24160 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Erik Johnston
9c3b906b3a Merge remote-tracking branch 'origin/develop' into matrix-org-hotfixes 2023-11-20 10:09:33 +00:00
Erik Johnston
6088303efb Speed up how quickly we launch new tasks (#16660) 
Now that we're reducing concurrency (#16656), this is more important.
 2023-11-17 16:36:02 +00:00
Patrick Cloke
d9dcfe2a35 Bump requests-toolbelt from 0.10.1 to 1.0.0. (#16659) 2023-11-17 10:23:07 -05:00
Erik Johnston
9c02ef21e0 Speed up purge room by adding index (#16657) 
What it says on the tin
 2023-11-17 14:15:44 +00:00
Erik Johnston
6fec2d035f Also discard 'caches' and 'backfill' stream POSITIONS (#16655) 
Follow on from #16640
 2023-11-17 14:14:29 +00:00
Patrick Cloke
bdb0cbc5ca Merge branch 'master' into develop 2023-11-17 08:43:47 -05:00
Michael Weimann
518e4de758 Update admin user API return types in docs. (#16654) 2023-11-17 13:38:25 +00:00
Erik Johnston
700c8a0de5 Reduce task concurrency (#16656) 2023-11-17 13:14:26 +00:00
Patrick Cloke
c4f5522189 Tweaks from review. v1.96.1 2023-11-17 08:01:13 -05:00
Patrick Cloke
6a1352e564 Move the forking note to 1.96.1. 2023-11-17 07:52:54 -05:00
Patrick Cloke
76f990c244 1.96.1 2023-11-17 07:51:59 -05:00
Patrick Cloke
47c682101f Fix building wheels in CI. (#16653) 
pip was using a vendored setuptools that was incompatible with
Python 3.12. Upgrading cibuildwheels to a version with a newer
version of pip (and thus a newer version of setuptools) fixes
the issue.
 2023-11-17 07:42:49 -05:00
Patrick Cloke
2de2258bd2 Add blogpost link to changelog. v1.96.0 2023-11-16 13:01:32 -05:00
Patrick Cloke
ff0148a165 1.96.0 2023-11-16 12:58:00 -05:00
Erik Johnston
f8f7355678 Merge remote-tracking branch 'origin/develop' into matrix-org-hotfixes 2023-11-16 16:57:54 +00:00
Erik Johnston
4d6b800385 Revert "Fix test not detecting tables with missing primary keys and missing replica identities, then add more replica identities. (#16647)" (#16652) 
This reverts commit 830988ae72.
 2023-11-16 16:57:26 +00:00
Erik Johnston
01b2477b10 Revert "Fix test not detecting tables with missing primary keys and missing replica identities, then add more replica identities. (#16647)" 
This reverts commit 830988ae72.
 2023-11-16 16:53:04 +00:00
Erik Johnston
a96086e9ed Merge remote-tracking branch 'origin/develop' into matrix-org-hotfixes 2023-11-16 16:50:37 +00:00
Erik Johnston
ef5329a9f9 Revert "Add a Postgres REPLICA IDENTITY to tables that do not have an implicit one. This should allow use of Postgres logical replication. (#16456)" (#16651) 
This reverts commit 69afe3f7a0.
 2023-11-16 16:48:48 +00:00
Erik Johnston
b20bdd3997 Merge remote-tracking branch 'origin/develop' into matrix-org-hotfixes 2023-11-16 16:27:21 +00:00
Erik Johnston
3e8531d3ba Speed up deleting device messages (#16643) 
Keeping track of a lower bound of stream ID where we've deleted everything below makes the queries much faster. Otherwise, every time we scan for rows to delete we'd re-scan across all the rows that have previously deleted (until the next table VACUUM).
 2023-11-16 15:19:35 +00:00
Erik Johnston
1b238e8837 Speed up persisting large number of outliers (#16649) 
Recalculating the roots tuple every iteration could be very expensive, so instead let's do a topological sort.
 2023-11-16 14:25:35 +00:00
Erik Johnston
fef08cbee8 Fix sending out of order POSITION over replication (#16639) 
If a worker reconnects to Redis we send out the current positions of all our streams. However, if we're also trying to send out a backlog of RDATA at the same time then we can end up sending a `POSITION` with the current token *before* we've sent all the RDATA before the current token.

This doesn't cause actual bugs as the receiving servers see the POSITION, fetch the relevant rows from the DB, and then ignore the old RDATA as they come in. However, this is inefficient so it'd be better if we didn't  send out-of-order positions
 2023-11-16 13:05:09 +00:00
Erik Johnston
898655fd12 More efficiently handle no-op POSITION (#16640) 
We may receive `POSITION` commands where we already know that worker has
advanced past that position, so there is no point in handling it.
 2023-11-16 12:32:17 +00:00
reivilibre
830988ae72 Fix test not detecting tables with missing primary keys and missing replica identities, then add more replica identities. (#16647) 
* Fix the CI query that did not detect all cases of missing primary keys

* Add more missing REPLICA IDENTITY entries

* Newsfile

Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org>

---------

Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org>
 2023-11-16 12:26:27 +00:00
David Robertson
43d1aa75e8 Add an Admin API to temporarily grant the ability to update an existing cross-signing key without UIA (#16634) 2023-11-15 17:28:10 +00:00
Sumner Evans
999bd77d3a Asynchronous Uploads (#15503) 
Support asynchronous uploads as defined in MSC2246.
 2023-11-15 09:19:24 -05:00
Patrick Cloke
80922dc46e Add links to pre-1.0 changelog issue/PR references. (#16638) 2023-11-15 13:31:24 +00:00
Patrick Cloke
f2f2c7c1f0 Use full GitHub links instead of bare issue numbers. (#16637) 2023-11-15 08:02:11 -05:00
Will Hunt
4dd18bdc2e Improve documentation for /_synapse/admin/v1/rooms/<room_id>/timestamp_to_event (#16631) 2023-11-14 11:43:44 -05:00
Nick Mills-Barrett
0e36a57b60 Remove whole table locks on push rule add/delete (#16051) 
The statements are already executed within a transaction thus a table
level lock is unnecessary.
 2023-11-13 16:57:44 +00:00
reivilibre
69afe3f7a0 Add a Postgres REPLICA IDENTITY to tables that do not have an implicit one. This should allow use of Postgres logical replication. (#16456) 
* Add Postgres replica identities to tables that don't have an implicit one

Fixes #16224

* Newsfile

Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org>

* Move the delta to version 83 as we missed the boat for 82

* Add a test that all tables have a REPLICA IDENTITY

* Extend the test to include when indices are deleted

* isort

* black

* Fully qualify `oid` as it is a 'hidden attribute' in Postgres 11

* Update tests/storage/test_database.py

Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>

* Add missed tables

---------

Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org>
Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>
 2023-11-13 16:03:22 +00:00
David Robertson
fb2554b11f Fix outbound_federation_restricted_to docs & note when added (#16628) 2023-11-13 14:26:49 +00:00
dependabot[bot]
7455b9e27d Bump serde from 1.0.190 to 1.0.192 (#16627) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-13 11:10:28 +00:00
dependabot[bot]
35fac66d20 Bump prometheus-client from 0.17.1 to 0.18.0 (#16626) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-13 11:09:30 +00:00
dependabot[bot]
69d1ee3feb Bump treq from 22.2.0 to 23.11.0 (#16623) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-13 11:08:31 +00:00
dependabot[bot]
f92af19fa5 Bump types-pyopenssl from 23.2.0.2 to 23.3.0.0 (#16625) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-13 11:06:10 +00:00
dependabot[bot]
22a513014d Bump types-bleach from 6.1.0.0 to 6.1.0.1 (#16624) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-13 11:05:37 +00:00
dependabot[bot]
ca7421b5fd Bump towncrier from 23.6.0 to 23.11.0 (#16622) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-13 11:05:02 +00:00
Patrick Cloke
2c6a7dfcbf Use attempt_to_set_autocommit everywhere. (#16615) 
To avoid asserting the type of the database connection.
 2023-11-09 16:19:42 -05:00
reivilibre
dc7f068d9c Fix a long-standing bug where Synapse would not unbind third-party identifiers for Application Service users when deactivated and would not emit a compliant response. (#16617) 
* Don't skip unbinding 3PIDs and returning success status when deactivating AS user

Fixes #16608

* Newsfile

Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org>

---------

Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org>
 2023-11-09 20:18:25 +00:00
Patrick Cloke
bc4372ad81 Use dbname instead of database for Postgres config. (#16618) 2023-11-09 14:40:45 -05:00
Patrick Cloke
9f514dd0fb Use _invalidate_cache_and_stream_bulk in more places. (#16616) 
This takes advantage of the new bulk method in more places to
invalidate caches for many keys at once (and then to stream that
over replication).
 2023-11-09 14:40:30 -05:00
Patrick Cloke
8c2d3d0b4c Merge remote-tracking branch 'origin/develop' into matrix-org-hotfixes 2023-11-09 11:14:57 -05:00
Patrick Cloke
ab3f1b3b53 Convert simple_select_one_txn and simple_select_one to return tuples. (#16612) 2023-11-09 11:13:31 -05:00
Patrick Cloke
ff716b483b Return attrs for more media repo APIs. (#16611) 2023-11-09 11:00:30 -05:00
David Robertson
91587d4cf9 Bulk-invalidate e2e cached queries after claiming keys (#16613) 
Co-authored-by: Patrick Cloke <patrickc@matrix.org>
 2023-11-09 15:57:09 +00:00
dependabot[bot]
f6aa047aa2 Bump pyicu from 2.11 to 2.12 (#16603) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-08 09:28:51 -05:00
dependabot[bot]
2a336cd2fc Bump serde_json from 1.0.107 to 1.0.108 (#16604) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-08 09:27:51 -05:00
Patrick Cloke
b77c9c3f73 Merge remote-tracking branch 'origin/develop' into matrix-org-hotfixes 2023-11-08 07:45:34 -05:00