Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Various features+fixes, ignoring works properly, load registration from file + async database #585

Open
wants to merge 47 commits into
base: main
Choose a base branch
from
Open

Various features+fixes, ignoring works properly, load registration from file + async database #585

wants to merge 47 commits into from

Conversation

girlbossceo
Copy link
Owner

@girlbossceo girlbossceo commented Oct 3, 2024 •
edited
Loading

Currently adds async database part one (has tons of performance boosts, improvements, etc), loading TURN secret and registration token from files on the filesystem, misc optimisations from me, MSC4151 support (room reporting), ignoring actually works now on clients like Cinny, and various other things

Async database part one: #551

Closes:

@jevolk @girlbossceo
simplify service trait bounds and lifetimes
2db017a 
Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
add str traits for split, between, unquote; consolidate tests
99ad404 
Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
add MapExpect to Result
2709995 
add DebugInspect to Result

move Result typedef into unit

Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
add expected! macro to checked math expression suite
3d4b0f1 
Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
add err log trait to Result
aa265f7 
Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
move common_elements util into unit
bd75ff6 
Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
add util functors for is_zero/is_equal; move clamp to math utils
6305364 
Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
add missing err! case
a5822eb 
Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
add is_not_found functor to error; tweak status code matcher
f7ce4db 
Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
re-export crates used by error macros
a5de274 
Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
add UnwrapInfallible to Result
6001014 
Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
Database Refactor
946ca36 
combine service/users data w/ mod unit

split sliding sync related out of service/users

instrument database entry points

remove increment crap from database interface

de-wrap all database get() calls

de-wrap all database insert() calls

de-wrap all database remove() calls

refactor database interface for async streaming

add query key serializer for database

implement Debug for result handle

add query deserializer for database

add deserialization trait for option handle

start a stream utils suite

de-wrap/asyncify/type-query count_one_time_keys()

de-wrap/asyncify users count

add admin query users command suite

de-wrap/asyncify users exists

de-wrap/partially asyncify user filter related

asyncify/de-wrap users device/keys related

asyncify/de-wrap user auth/misc related

asyncify/de-wrap users blurhash

asyncify/de-wrap account_data get; merge Data into Service

partial asyncify/de-wrap uiaa; merge Data into Service

partially asyncify/de-wrap transaction_ids get; merge Data into Service

partially asyncify/de-wrap key_backups; merge Data into Service

asyncify/de-wrap pusher service getters; merge Data into Service

asyncify/de-wrap rooms alias getters/some iterators

asyncify/de-wrap rooms directory getters/iterator

partially asyncify/de-wrap rooms lazy-loading

partially asyncify/de-wrap rooms metadata

asyncify/dewrap rooms outlier

asyncify/dewrap rooms pdu_metadata

dewrap/partially asyncify rooms read receipt

de-wrap rooms search service

de-wrap/partially asyncify rooms user service

partial de-wrap rooms state_compressor

de-wrap rooms state_cache

de-wrap room state et al

de-wrap rooms timeline service

additional users device/keys related

de-wrap/asyncify sender

asyncify services

refactor database to TryFuture/TryStream

refactor services for TryFuture/TryStream

asyncify api handlers

additional asyncification for admin module

abstract stream related; support reverse streams

additional stream conversions

asyncify state-res related

Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
handle serde_json for deserialized()
4776fe6 
Signed-off-by: Jason Volk <[email protected]>
jevolk and others added 24 commits October 25, 2024 00:36
@jevolk @girlbossceo
optimize auth_chain short_id to event_id translation step
36677bb 
Signed-off-by: Jason Volk <[email protected]>
@girlbossceo
bump ruma, cargo.lock, and deps
8311952 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
send EDUs to appservices if in events
fafe320 
to_device is not supported yet

Signed-off-by: strawberry <[email protected]>
@girlbossceo
dont send read receipts and typing indicators from ignored users
890ee84 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
dont send non-state events from ignored users over sync
2083c38 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
dont allow sending/receiving room invites with ignored users
4413793 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
use ok_or_else for a rare error
b64a235 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
fix list_rooms admin command filters
ee1580e 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
add support for reading a registration token from a file
7a59add 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
dont send events from ignored users over /messages
6a81bf2 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
dont send non-state events from ignored users over /context/{eventId}
a9e3e8f 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
remove unnecessary full type annos
115ea03 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
update last_seen_ip and last_seen_ts on updating device metadata
4eb7ad7 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
fix: dont add remote users for push targets, use hashset instead of vec
9836385 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
drop unnecessary error to debug_warn
54a107c 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
add MSC4151 room reporting support
ab9a65d 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
fix room directory regression
bd56d83 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
miniscule spaces code optimisations
fa7c120 
still terrible though

Signed-off-by: strawberry <[email protected]>
@jevolk @girlbossceo
consume all bytes for top-level Ignore; add comments/tweaks
c6b7c24 
Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
fix get_all_media_keys deserialization
2d049da 
Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
fix trait-solver issue requiring recursion_limit increase
bd9a9cc 
Signed-off-by: Jason Volk <[email protected]>
@jevolk @girlbossceo
fix aliasid_alias key deserialization
ba683cf 
Signed-off-by: Jason Volk <[email protected]>
@morguldir @girlbossceo
fix sliding sync room type filter regression
9eace1f 
Signed-off-by: strawberry <[email protected]>
@girlbossceo
mark the server user bot as online/offline on shutdown/startup
8eec78e 
Signed-off-by: strawberry <[email protected]>
@girlbossceo girlbossceo mentioned this pull request Oct 31, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@girlbossceo @jevolk @morguldir