1
0
Commit Graph

396 Commits

Author SHA1 Message Date
Andrew Morgan
62c75e6536 Improve get auth chain difference algorithm. (#7095)
* commit '4a17a647a':
  Improve get auth chain difference algorithm. (#7095)
2020-03-24 14:42:21 +00:00
Andrew Morgan
5dfd887245 Break down monthly active users by appservice_id (#7030)
* commit '1d66dce83':
  Break down monthly active users by appservice_id  (#7030)
2020-03-24 14:24:25 +00:00
Andrew Morgan
35d74a232c Clarify list/set/dict/tuple comprehensions and enforce via flake8 (#6957)
* commit '509e381af':
  Clarify list/set/dict/tuple comprehensions and enforce via flake8 (#6957)
  changelog
  Increase MAX_EVENTS_BEHIND for replication clients
2020-03-24 13:16:43 +00:00
Andrew Morgan
0818ea48e7 Merge pull request #6872 from matrix-org/rav/dictproperty
* commit '3f1cd1479':
  changelog
  Rewrite _EventInternalMetadata to back it with a _dict
  Replace _event_dict_property with DictProperty
2020-03-24 13:13:51 +00:00
Andrew Morgan
ae9e55b13c Add typing to SyncHandler (#6821)
* commit 'b9391c957':
  Add typing to SyncHandler (#6821)
2020-03-23 17:04:47 +00:00
Andrew Morgan
92ec7ba1fb Add rooms.room_version column (#6729)
* commit '8df862e45':
  Add `rooms.room_version` column (#6729)
2020-03-23 13:25:38 +00:00
Andrew Morgan
5a32d2941e Make 'event.redacts' never raise. (#6771)
* commit 'fa4d609e2':
  Make 'event.redacts' never raise. (#6771)
  Fixup changelog
  Fixup changelog
  Fixup changelog
2020-03-23 13:16:57 +00:00
Andrew Morgan
1e34631d1a Add local_current_membership table (#6655)
* commit '28c98e51f':
  Add `local_current_membership` table (#6655)
2020-03-23 11:34:19 +00:00
Andrew Morgan
35d1ec2c8f Allow admin users to create or modify users without a shared secret (#6495)
* commit 'd2906fe66':
  Allow admin users to create or modify users without a shared secret (#6495)
  Fixup changelog
2020-03-23 11:31:22 +00:00
Andrew Morgan
0fec900aab port BackgroundUpdateTestCase to HomeserverTestCase (#6653)
* commit 'd20c34654':
  port BackgroundUpdateTestCase to HomeserverTestCase (#6653)
  changelog
  Fix exceptions in log when rejected event is replicated
  async/await for SyncReplicationHandler.process_and_notify
  Clarify documentation on get_event* methods
2020-03-20 16:59:35 +00:00
Andrew Morgan
eb08accdba Merge pull request #6629 from matrix-org/rav/kill_event_reference_hashes
* commit '1807db5e7':
  changelog
  Remove unused get_latest_event_ids_and_hashes_in_room
  Remove unused get_prev_events_and_hashes_for_room
  Remove unused hashes and depths from _update_membership params
  Remove unused hashes and depths from create_event params
  Remove unused hashes and depths from create_new_client_event params
  replace get_prev_events_and_hashes_for_room with get_prev_events_for_room in create_new_client_event
  rename get_prev_events_for_room to get_prev_events_and_hashes_for_room
2020-03-20 16:59:26 +00:00
Andrew Morgan
02a2fd0f6a Split state groups into a separate data store (#6296)
* commit '75d8f26ac':
  Split state groups into a separate data store (#6296)
2020-03-20 15:01:31 +00:00
Andrew Morgan
032fed6f42 Add database config class (#6513)
* commit '2284eb3a5':
  Add database config class (#6513)
  too many parens
2020-03-20 14:39:41 +00:00
Andrew Morgan
9ccb061352 Fix race which caused deleted devices to reappear (#6514)
* commit '40eda8493':
  Fix race which caused deleted devices to reappear (#6514)
2020-03-19 17:47:40 +00:00
Andrew Morgan
5069b7fbe7 Back out perf regression from get_cross_signing_keys_from_cache. (#6494)
* commit 'adfdd82b2':
  Back out perf regression from get_cross_signing_keys_from_cache. (#6494)
  Fix comment
  Fix port db script
  Newsfile
  Fixup tests
  Move start up DB checks to main data store.
  Pass Database into the data store
  Move are_all_users_on_domain checks to main data store.
  Change DataStores to accept 'database' param.
2020-03-19 17:14:53 +00:00
Andrew Morgan
60baffdaa4 Merge pull request #6469 from matrix-org/erikj/make_database_class
* commit 'f3ea2f5a0':
  Remove unused var
  Fix DB scripts
  Newsfile
  Move background update handling out of store
  Comments
  Move DB pool and helper functions into dedicated Database class
2020-03-19 17:12:37 +00:00
Andrew Morgan
237f3fe187 Merge pull request #6464 from matrix-org/erikj/make_public_sql_base
* commit 'ddbbfc951':
  Newsfile
  Remove underscore from SQLBaseStore functions
  Don't call SQLBaseStore methods from outside stores
2020-03-19 16:28:41 +00:00
Andrew Morgan
d4ac2758dd Implementation of MSC2314 (#6176)
* commit '0f87b912a':
  Implementation of MSC2314 (#6176)
2020-03-18 17:53:47 +00:00
Andrew Morgan
8c493de8e3 add etag and count to key backup endpoints (#5858)
* commit '0d27aba90':
  add etag and count to key backup endpoints (#5858)
2020-03-18 17:48:53 +00:00
Erik Johnston
4a17a647a9 Improve get auth chain difference algorithm. (#7095)
It was originally implemented by pulling the full auth chain of all
state sets out of the database and doing set comparison. However, that
can take a lot work if the state and auth chains are large.

Instead, lets try and fetch the auth chains at the same time and
calculate the difference on the fly, allowing us to bail early if all
the auth chains converge. Assuming that the auth chains do converge more
often than not, this should improve performance. Hopefully.
2020-03-18 16:46:41 +00:00
Andrew Morgan
21fcaa872c Merge pull request #6295 from matrix-org/erikj/split_purge_history
* commit 'f713c01e2':
  Move type annotation into docstring
  Fix deleting state groups during room purge.
  Use correct type annotation
  Change to not require a state_groups.room_id index.
  Fix up comment
  Update log line to lie a little less
  Add state_groups.room_id index
  Docstrings
  Fix purge room API
  Newsfile
  Split purge API into events vs state
2020-03-18 16:14:17 +00:00
Andrew Morgan
55be059f91 Merge pull request #5727 from matrix-org/uhoreg/e2e_cross-signing2-part3
* commit '53d7680e3':
  Update synapse/storage/data_stores/main/devices.py
  rename get_devices_by_remote to get_device_updates_by_remote
  black
  apply changes as a result of PR review
  don't error if federation query doesn't have cross-signing keys
  move get_e2e_cross_signing_key to EndToEndKeyWorkerStore so it works with workers
  black
  vendor-prefix the EDU name until MSC1756 is merged into the spec
  fix unit test
  add news file
  update to work with newer code, and fix formatting
  add missing param
  make black happy
  don't crash if the user doesn't have cross-signing keys
  implement federation parts of cross-signing
2020-03-16 19:23:32 +00:00
Andrew Morgan
6d29b53424 Merge pull request #6294 from matrix-org/erikj/add_state_storage 2020-03-16 19:21:18 +00:00
Andrew Morgan
44b1bc5cc2 Merge pull request #6240 from matrix-org/erikj/split_out_persistence_store 2020-03-16 15:42:55 +00:00
Andrew Morgan
bf117c452a Merge pull request #6291 from matrix-org/erikj/fix_cache_descriptor 2020-03-16 15:36:57 +00:00
Andrew Morgan
97f1b92b56 Merge pull request #6253 from matrix-org/uhoreg/e2e_backup_delete_keys
* commit 'da78f6177':
  remove unneeded imports
  switch to using HomeserverTestCase
  remove some unnecessary lines
  add changelog
  delete keys when deleting backups
2020-03-16 15:31:19 +00:00
Andrew Morgan
bf1fad8462 Merge pull request #6231 from matrix-org/erikj/refactor_stores 2020-03-16 15:13:49 +00:00
Neil Johnson
1d66dce83e Break down monthly active users by appservice_id (#7030)
* Break down monthly active users by appservice_id and emit via prometheus.

Co-authored-by: Brendan Abolivier <babolivier@matrix.org>
2020-03-06 18:14:19 +00:00
Andrew Morgan
20fccf0067 Merge pull request #6193 from matrix-org/uhoreg/interpret_device_key_in_storage 2020-02-26 12:37:22 +00:00
Andrew Morgan
20893707bf Fix MAU reaping where reserved users are specified. (#6168) 2020-02-26 12:36:45 +00:00
Andrew Morgan
22fc7597f7 Merge pull request #6186 from matrix-org/erikj/disable_sql_bytes 2020-02-26 12:36:21 +00:00
Andrew Morgan
f5a623f070 Merge pull request #6146 from matrix-org/erikj/fix_destination_retry_timings 2020-02-26 12:09:38 +00:00
Andrew Morgan
2ac458d86d Merge pull request #6145 from matrix-org/erikj/fix_censored_redactions 2020-02-26 12:08:58 +00:00
Andrew Morgan
eba1b9c156 Fix dummy event insertion consent bug (#6053) 2020-02-25 17:54:48 +00:00
Andrew Morgan
f6d3b67360 Merge pull request #6098 from matrix-org/erikj/cleanup_user_ips_2 2020-02-25 17:54:41 +00:00
Andrew Morgan
41e59e6ac3 Merge pull request #6089 from matrix-org/erikj/cleanup_user_ips 2020-02-25 17:54:30 +00:00
Andrew Morgan
74912d4eab Add 'failure_ts' column to 'destinations' table (#6016) 2020-02-25 14:28:24 +00:00
Andrew Morgan
6bedb3fe1c Merge pull request #5934 from matrix-org/erikj/censor_redactions 2020-02-25 11:41:35 +00:00
Andrew Morgan
87856c6aa9 Servers-known-about statistic (#5981) 2020-02-25 11:37:02 +00:00
Andrew Morgan
3d5f1ebf06 Merge pull request #5902 from matrix-org/hs/exempt-support-users-from-consent 2020-02-24 17:19:09 +00:00
Patrick Cloke
509e381afa Clarify list/set/dict/tuple comprehensions and enforce via flake8 (#6957)
Ensure good comprehension hygiene using flake8-comprehensions.
2020-02-21 07:15:07 -05:00
Andrew Morgan
408959c9d9 Merge pull request #5788 from matrix-org/rav/metaredactions 2020-02-20 15:58:43 +00:00
Andrew Morgan
bab6f6052c Merge pull request #5746 from matrix-org/erikj/test_bg_update_currnet_state 2020-02-20 15:41:31 +00:00
Andrew Morgan
471a6b1b56 Convert RedactionTestCase to modern test style (#5768) 2020-02-19 16:05:44 +00:00
Andrew Morgan
f590f77a16 Replace returnValue with return (#5736) 2020-02-19 15:11:59 +00:00
Andrew Morgan
adb043107f Support Prometheus_client 0.4.0+ (#5636) 2020-02-19 11:46:23 +00:00
Andrew Morgan
2f450fa149 Implement access token expiry (#5660) 2020-02-17 17:17:02 +00:00
Andrew Morgan
ee2de6734b Remove access-token support from RegistrationStore.register (#5642) 2020-02-17 16:36:11 +00:00
Richard van der Hoff
43b2be9764 Replace _event_dict_property with DictProperty
this amounts to the same thing, but replaces `_event_dict` with `_dict`, and
removes some of the function layers generated by `property`.
2020-02-14 16:42:37 +00:00
Andrew Morgan
622d0be1b3 Fix with isort==4.3.21 and black==19.3b0 2020-02-14 14:27:12 +00:00