1
0
Commit Graph

1847 Commits

Author SHA1 Message Date
Andrew Morgan
1a051ca537 look up cross-signing keys from the DB in bulk (#6486)
* commit 'cb2db1799':
  look up cross-signing keys from the DB in bulk (#6486)
2020-03-19 17:59:50 +00:00
Andrew Morgan
49ba0a7434 Merge pull request #6511 from matrix-org/erikj/remove_db_config_from_apps
* commit 'b8e4b39b6':
  Add new config param to docstring and add types
  Newsfile
  Fix upgrade db script
  Remove database config parsing from apps.
2020-03-19 17:59:17 +00:00
Andrew Morgan
050bc5bf40 Merge pull request #6517 from matrix-org/rav/event_auth/13
* commit '894d2adda':
  changelog
  convert to async: FederationHandler._process_received_pdu
  convert to async: FederationHandler._get_state_for_room
  convert to async: FederationHandler.on_receive_pdu
  Convert federation backfill to async
2020-03-19 17:58:58 +00:00
Andrew Morgan
fe97d69358 Merge pull request #6504 from matrix-org/erikj/account_validity_async_await
* commit '31905a518':
  Newsfile
  Port handlers.account_validity to async/await.
  Port handlers.account_data to async/await.
2020-03-19 17:57:34 +00:00
Andrew Morgan
9ccb061352 Fix race which caused deleted devices to reappear (#6514)
* commit '40eda8493':
  Fix race which caused deleted devices to reappear (#6514)
2020-03-19 17:47:40 +00:00
Andrew Morgan
8c190d0b7e Merge pull request #6505 from matrix-org/erikj/make_deferred_yiedable
* commit '35f3c366e':
  Update comment
  Newsfile
  Fix make_deferred_yieldable to work with coroutines
2020-03-19 17:47:05 +00:00
Andrew Morgan
7c5aae509f Merge pull request #6506 from matrix-org/erikj/remove_snapshot_cache
* commit 'e3f528c54':
  Newsfile
  Remove SnapshotCache in favour of ResponseCache
2020-03-19 17:46:42 +00:00
Andrew Morgan
5069b7fbe7 Back out perf regression from get_cross_signing_keys_from_cache. (#6494)
* commit 'adfdd82b2':
  Back out perf regression from get_cross_signing_keys_from_cache. (#6494)
  Fix comment
  Fix port db script
  Newsfile
  Fixup tests
  Move start up DB checks to main data store.
  Pass Database into the data store
  Move are_all_users_on_domain checks to main data store.
  Change DataStores to accept 'database' param.
2020-03-19 17:14:53 +00:00
Andrew Morgan
2beae00b3b Merge pull request #6484 from matrix-org/erikj/port_sync_handler
* commit 'a9b393340':
  Fixup functions to consistently return deferreds
  Newsfile
  Port SyncHandler to async/await
2020-03-19 17:13:08 +00:00
Andrew Morgan
60baffdaa4 Merge pull request #6469 from matrix-org/erikj/make_database_class
* commit 'f3ea2f5a0':
  Remove unused var
  Fix DB scripts
  Newsfile
  Move background update handling out of store
  Comments
  Move DB pool and helper functions into dedicated Database class
2020-03-19 17:12:37 +00:00
Andrew Morgan
9120098a37 Merge pull request #6482 from matrix-org/erikj/port_rest_v1
* commit 'af5d0ebc7':
  Newsfile
  Fixup tests
  Port rest/v1 to async/await
2020-03-19 16:34:10 +00:00
Andrew Morgan
237f3fe187 Merge pull request #6464 from matrix-org/erikj/make_public_sql_base
* commit 'ddbbfc951':
  Newsfile
  Remove underscore from SQLBaseStore functions
  Don't call SQLBaseStore methods from outside stores
2020-03-19 16:28:41 +00:00
Andrew Morgan
00f1c3b40d Merge pull request #6329 from matrix-org/babolivier/context_filters
* commit 'c530f9af4':
  Un-remove room purge test
  Incorporate review
  Format changelog
  Update changelog since this isn't going to be featured in 1.6.0
  Also filter state events
  Only filter if a filter was provided
  Update copyright
  Lint
  Update copyrights
  Changelog
  Add tests for /search
  Merge labels tests for /context and /messages
  Add test case
  Filter events_before and events_after in /context requests
2020-03-19 16:18:41 +00:00
Andrew Morgan
0427f070cb privacy by default for room dir (#6355)
* commit 'cb0aeb147':
  privacy by default for room dir (#6355)
2020-03-19 16:17:40 +00:00
Andrew Morgan
e66b3e22df Add ephemeral messages support (MSC2228) (#6409)
* commit '54dd5dc12':
  Add ephemeral messages support (MSC2228) (#6409)
2020-03-19 16:08:16 +00:00
Andrew Morgan
603166f13c Fix: Pillow error when uploading RGBA image (#3325) (#6241)
* commit '81731c6e7':
  Fix: Pillow error when uploading RGBA image (#3325) (#6241)
  Add User-Interactive Auth to /account/3pid/add (#6119)
  Lint
  Changelog
  Discard retention policies when retrieving state
  blacklist more tests
  Newsfile
  Add tests
  Propagate reason in remotely rejected invites
  MSC2367 Allow reason field on all member events
2020-03-19 16:07:29 +00:00
Andrew Morgan
d4ac2758dd Implementation of MSC2314 (#6176)
* commit '0f87b912a':
  Implementation of MSC2314 (#6176)
2020-03-18 17:53:47 +00:00
Andrew Morgan
8c493de8e3 add etag and count to key backup endpoints (#5858)
* commit '0d27aba90':
  add etag and count to key backup endpoints (#5858)
2020-03-18 17:48:53 +00:00
Andrew Morgan
b8344cabcd Merge pull request #6358 from matrix-org/babolivier/message_retention
* commit 'd31f69afa':
  clean up buildkite output
  Don't restrict the tests to v1 rooms
  Fix worker mode
  Fix 3PID invite exchange
  Lint again
  Lint again
  Lint
  Don't apply retention policy based filtering on state events
  Implement per-room message retention policies
2020-03-18 17:22:33 +00:00
Andrew Morgan
2de57b8969 Remove assertion and provide a clear warning on startup for missing public_baseurl (#6379)
* commit 'ce578031f':
  Remove assertion and provide a clear warning on startup for missing public_baseurl (#6379)
2020-03-18 16:35:27 +00:00
Andrew Morgan
0f54acfe25 Improve the performance of structured logging (#6322)
* commit '9eebd4604':
  Improve the performance of structured logging (#6322)
2020-03-18 16:32:40 +00:00
Andrew Morgan
cc7e4cb952 Merge pull request #6392 from matrix-org/babolivier/fix-1623
* commit '78cfc05fc':
  Lint
  Changelog
  Test if a purge can make /messages return 500 responses
2020-03-18 16:32:15 +00:00
Andrew Morgan
c7f4de278e Blacklist PurgeRoomTestCase (#6361)
* commit 'c350bc2f9':
  Blacklist PurgeRoomTestCase (#6361)
2020-03-18 16:28:45 +00:00
Andrew Morgan
21fcaa872c Merge pull request #6295 from matrix-org/erikj/split_purge_history
* commit 'f713c01e2':
  Move type annotation into docstring
  Fix deleting state groups during room purge.
  Use correct type annotation
  Change to not require a state_groups.room_id index.
  Fix up comment
  Update log line to lie a little less
  Add state_groups.room_id index
  Docstrings
  Fix purge room API
  Newsfile
  Split purge API into events vs state
2020-03-18 16:14:17 +00:00
Andrew Morgan
eaabbf3f7c Fix bug which caused rejected events to be stored with the wrong room state (#6320)
* commit '807ec3bd9':
  Fix bug which caused rejected events to be stored with the wrong room state  (#6320)
2020-03-16 19:26:00 +00:00
Andrew Morgan
6e290f33e2 Merge pull request #6331 from matrix-org/rav/url_preview_limit_title
* commit '02f99906f':
  Apply suggestions from code review
  Strip overlong OpenGraph data from url preview
2020-03-16 19:25:32 +00:00
Andrew Morgan
974d9e8e67 Remove the psutil dependency (#6318)
* commit '4e1c7b79f':
  Remove the psutil dependency (#6318)
2020-03-16 19:25:00 +00:00
Andrew Morgan
b883522505 Merge pull request #6301 from matrix-org/babolivier/msc2326
* commit 'f496d2587':
  Incorporate review
  Factor out an _AsyncEventContextImpl (#6298)
  Update synapse/storage/data_stores/main/schema/delta/56/event_labels.sql
  Add more data to the event_labels table and fix the indexes
  Add unstable feature flag
  Lint
  Incorporate review
  Lint
  Changelog
  Add integration tests for /messages
  Add more integration testing
  Add integration tests for sync
  Add unit tests
  Add index on label
  Implement filtering
  Store labels for new events
  Add database table for keeping track of labels on events
2020-03-16 19:24:41 +00:00
Andrew Morgan
55be059f91 Merge pull request #5727 from matrix-org/uhoreg/e2e_cross-signing2-part3
* commit '53d7680e3':
  Update synapse/storage/data_stores/main/devices.py
  rename get_devices_by_remote to get_device_updates_by_remote
  black
  apply changes as a result of PR review
  don't error if federation query doesn't have cross-signing keys
  move get_e2e_cross_signing_key to EndToEndKeyWorkerStore so it works with workers
  black
  vendor-prefix the EDU name until MSC1756 is merged into the spec
  fix unit test
  add news file
  update to work with newer code, and fix formatting
  add missing param
  make black happy
  don't crash if the user doesn't have cross-signing keys
  implement federation parts of cross-signing
2020-03-16 19:23:32 +00:00
Andrew Morgan
6d29b53424 Merge pull request #6294 from matrix-org/erikj/add_state_storage 2020-03-16 19:21:18 +00:00
Andrew Morgan
d10606afc7 Merge pull request #6307 from matrix-org/erikj/fix_purge_room 2020-03-16 15:44:39 +00:00
Andrew Morgan
44b1bc5cc2 Merge pull request #6240 from matrix-org/erikj/split_out_persistence_store 2020-03-16 15:42:55 +00:00
Andrew Morgan
bf117c452a Merge pull request #6291 from matrix-org/erikj/fix_cache_descriptor 2020-03-16 15:36:57 +00:00
Andrew Morgan
c14c890bf3 Merge pull request #6279 from matrix-org/erikj/federation_server_async_await
* commit 'b4465564c':
  Don't return coroutines
  Make concurrently_execute work with async/await
  Newsfile
  Port federation_server to async/await
2020-03-16 15:34:59 +00:00
Andrew Morgan
446c957ad1 Merge pull request #6263 from matrix-org/erikj/caches_return_deferreds
* commit '561133c3c':
  Update docstring
  Newsfile
  Quick fix to ensure cache descriptors always return deferreds
2020-03-16 15:33:49 +00:00
Andrew Morgan
97f1b92b56 Merge pull request #6253 from matrix-org/uhoreg/e2e_backup_delete_keys
* commit 'da78f6177':
  remove unneeded imports
  switch to using HomeserverTestCase
  remove some unnecessary lines
  add changelog
  delete keys when deleting backups
2020-03-16 15:31:19 +00:00
Andrew Morgan
1b5ea48ed2 Merge pull request #6255 from matrix-org/erikj/stats_config
* commit '87259b3a3':
  Fix tests
  Newsfile
  Remove repeated calls to config.stats_enabled.
2020-03-16 15:31:12 +00:00
Andrew Morgan
759e8dd793 Option to suppress resource exceeded alerting (#6173)
* commit '2794b7905':
  Option to suppress resource exceeded alerting (#6173)
2020-03-16 15:27:03 +00:00
Andrew Morgan
bf1fad8462 Merge pull request #6231 from matrix-org/erikj/refactor_stores 2020-03-16 15:13:49 +00:00
Andrew Morgan
8165d3c81d Merge pull request #5726 from matrix-org/uhoreg/e2e_cross-signing2-part2
* commit '276173163':
  Add changelog entry
  fix doc strings
  make isort happy
  add some comments
  drop some logger lines to debug
  make changes based on PR feedback
  add function docs
  use something that's the right type for user_id
  run black
  split out signature processing into separate functions
  avoid modifying input parameter
  fix test
  update with newer coding style
  add test
  make isort happy
  make black happy
  allow uploading signatures of master key signed by devices
  implement device signature uploading/fetching
2020-03-16 14:59:03 +00:00
Andrew Morgan
95b332e90a Remove Auth.check method (#6217)
* commit '93eaeec75':
  Remove Auth.check method (#6217)
  add note about database upgrade
  use the right function for when we're already in runInteraction
  add user signature stream change cache to slaved device store
  black
  use stream ID generator instead of timestamp
  make isort happy
  apply PR review suggestions
  fix formatting
  add changelog
  make changes from PR review
  don't need to return the hidden column any more
  really fix queries to work with Postgres
  PostgreSQL, Y U no like?
  remove extra SQL query param
  add changelog file
  apply changes from PR review
  allow uploading keys for cross-signing
  allow devices to be marked as "hidden"
2020-03-16 14:55:37 +00:00
Andrew Morgan
3261565623 Fix presence timeouts when synchrotron restarts. (#6212) 2020-02-26 12:40:51 +00:00
Andrew Morgan
20fccf0067 Merge pull request #6193 from matrix-org/uhoreg/interpret_device_key_in_storage 2020-02-26 12:37:22 +00:00
Andrew Morgan
4b2d706900 Merge pull request #6189 from matrix-org/uhoreg/e2e_backup_optional_version 2020-02-26 12:37:13 +00:00
Andrew Morgan
20893707bf Fix MAU reaping where reserved users are specified. (#6168) 2020-02-26 12:36:45 +00:00
Andrew Morgan
22fc7597f7 Merge pull request #6186 from matrix-org/erikj/disable_sql_bytes 2020-02-26 12:36:21 +00:00
Andrew Morgan
aac22dc0d4 Merge pull request #6127 from matrix-org/erikj/patch_inner 2020-02-26 12:34:14 +00:00
Andrew Morgan
846f1c0593 Add domain validation when creating room with list of invitees (#6121) 2020-02-26 12:33:59 +00:00
Andrew Morgan
f29da285bc send 404 as http-status when filter-id is unknown to the server (#2380) 2020-02-26 12:33:37 +00:00
Andrew Morgan
aa4590795a Fix races in room stats (and other) updates. (#6187) 2020-02-26 12:33:19 +00:00