TODO.md (20908B)
1 # TODO 2 3 ## Open 4 5 It seems that Microsoft is planning to laminate Basic HTTP Auth, so make a plan, see https://codeberg.org/grunfink/snac2/issues/350 6 7 Investigate the problem with boosts inside the same instance (see https://codeberg.org/grunfink/snac2/issues/214). 8 9 Editing / Updating a post does not index newly added hashtags. 10 11 Unfollowing guppe groups seems to work (http status of 200), but messages continue to arrive as if it didn't. 12 13 Important: deleting a follower should do more that just delete the object, see https://codeberg.org/grunfink/snac2/issues/43#issuecomment-956721 14 15 ## Wishlist 16 17 Add account reporting. 18 19 Add a list option to hide member posts from the main timeline, see https://codeberg.org/grunfink/snac2/issues/383 20 21 The instance timeline should also show boosts from users. 22 23 Mastoapi: implement /v1/conversations. 24 25 Track "BadgeFed - ActivityPub Badges" https://github.com/tryvocalcat/badgefed 26 27 Track 'Event' data types standardization; how to add plan-to-attend and similar activities (more info: https://event-federation.eu/). Friendica interacts with events via activities `Accept` (will go), `TentativeAccept` (will try to go) or `Reject` (cannot go) (`object` field as id, not object). `Undo` for any of these activities cancel (`object` as an object, not id). 28 29 Implement "FEP-3b86: Activity Intents" https://codeberg.org/fediverse/fep/src/branch/main/fep/3b86/fep-3b86.md 30 31 Track "FEP-ef61: Portable Objects" https://codeberg.org/fediverse/fep/src/branch/main/fep/ef61/fep-ef61.md 32 33 Integrate "Added handling for International Domain Names" PR https://codeberg.org/grunfink/snac2/pulls/104 34 35 Do something about Akkoma and Misskey's quoted replies (they use the `quoteUrl` field instead of `inReplyTo`). 36 37 Take a look at crashes in the brittle Mastodon official app (crashes when hitting the reply button, crashes or 'ownVotes is null' errors when trying to show polls). 38 39 The 'history' pages are just monthly HTML snapshots of the local timeline. This is ok and cheap and easy, but is problematic if you e.g. intentionally delete a post because it will remain there in the history forever. If you activate local timeline purging, purged entries will remain in the history as 'ghosts', which may or may not be what the user wants. 40 41 ## Closed 42 43 Start a TODO file (2022-08-25T10:07:44+0200). 44 45 Change the layout to be multi-user (2022-08-25T16:23:17+0200). 46 47 Read address:port from server.json (2022-08-26T09:14:08+0200). 48 49 Added an installation setup (2022-08-26T09:39:46+0200). 50 51 Purge timeline entries older than a configurable value (2022-08-26T13:15:21+0200). 52 53 Move all the interactive code (like initdb()) to a special source file that is only imported on demand (2022-08-26T18:08:05+0200). 54 55 Add Basic Authentication for /admin* (2022-08-28T18:55:05+0200). 56 57 Add unfollow (2022-08-28T19:59:29+0200). 58 59 Generate the /outbox, unpaged, of the 20 latest entries, like what honk does (2022-08-29T14:29:48+0200). 60 61 If a user serves a static style.css file, it's embedded in the HTML (2022-08-29T14:52:57+0200). 62 63 Filter note texts through a Markdown-like filter (2022-08-29T21:06:47+0200). 64 65 If a `Like` or `Announce` is received from the exterior but the object is of a different user in the same instance, when the object is resolved a loop happens SNAC/activitypub.py:506: (2022-08-30T10:03:03+0200). 66 67 Ensure that likes and boosts are applied to the object instead of the container. More on this: for Mastodon, we're showing the '.../activity' link instead of the proper Note (2022-08-30T11:57:31+0200). 68 69 Fix signature checks (2022-08-30T18:32:22+0200). 70 71 Add @user@host citation in notes (2022-08-31T10:42:46+0200). 72 73 Add a snac.L() localisation function. 74 75 Add an `adduser` command-line option (2022-08-31T19:02:22+0200). 76 77 `Accept` + `Follow` types should not be trusted (anyone can be followed by sending them) (2022-09-01T08:49:57+0200). 78 79 It happened twice that a reply-to Note is lost (from the web) (2022-09-02T12:31:49+0200). 80 81 Implement the like button (2022-09-02T19:28:04+0200). 82 83 Implement the boost button (2022-09-02T19:28:04+0200). 84 85 Implement the follow button (2022-09-02T19:28:04+0200). 86 87 Implement the unfollow button (2022-09-02T19:28:04+0200). 88 89 Implement the mute button (2022-09-02T19:28:04+0200). 90 91 Don't write messages in the timeline if they are already there (2022-09-03T19:14:58+0200). 92 93 Implement the Emoji tags in Notes (2022-09-03T22:14:56+0200). 94 95 Implement the 'one page' timeline (2022-09-04T05:41:07+0200). 96 97 Re-implement the renaming of updated messages in the local time (2022-09-04T05:58:51+0200). 98 99 Add support for a server `greeting.html` that will be returned when the server URL is queried, with a special mark to insert the user list (2022-09-05T10:05:21+0200). 100 101 Implement HTML caches for both timelines (2022-09-05T13:45:27+0200). 102 103 Implement a history for the local timeline (2022-09-05T14:20:15+0200). 104 105 Disable the Boost button for private messages (2022-09-05T19:32:15+0200). 106 107 Implement a user config page, where they can change their name, avatar, bio and password (2022-09-05T22:29:26+0200). 108 109 Also replace Emoji tags in people's names (2022-09-05T23:00:29+0200). 110 111 Implement `Delete` + `Tombstone` on input (2022-09-07T09:20:20+0200). 112 113 Implement `Delete` + `Tombstone` on output (2022-09-07T09:42:09+0200). 114 115 Entries in the local timeline appear again after being shown in a thread. Try implementing an 'already shown entries' set (2022-09-07T11:21:52+0200). 116 117 The Delete button doesn't work for Likes and Announces (it points to the wrong message id) (2022-09-07T15:46:29+0200). 118 119 Document `server.json` in the admin manual (2022-09-08T11:01:43+0200). 120 121 Document the command-line interface in the user manual (2022-09-08T11:26:11+0200). 122 123 Document the web interface in the user manual (2022-09-08T14:00:11+0200). 124 125 Enable back the caches (2022-09-08T19:12:51+0200). 126 127 Do not show `Like` or `Boost` buttons if that was already done (2022-09-12T19:29:04+0200). 128 129 Parents of a parent should also move up the timeline (2022-09-13T22:41:23+0200). 130 131 Started the **real** version (developed in C instead of Python) (2022-09-19T20:40:42 2022 +0200). 132 133 When a new note has an in-reply-to, also download it (2022-09-24T07:20:16+0200). 134 135 After 'Unfollow' or 'MUTE', the timeline should be rebuilt (regardless of the cached version) (2022-10-01T20:27:00+0200). 136 137 Should this user's notes with in_reply_to be resolved inside the object? (2022-10-01T20:27:52+0200). 138 139 Should admirations download the admired object into the timeline instead of resolving? (2022-10-01T20:27:52+0200). 140 141 Add a user configuration flag to hide likes from the timeline (2022-10-01T20:27:52+0200). 142 143 Implement an input queue (2022-10-01T20:27:52+0200). 144 145 Refactor HTML rendering because it's a mess and write build_timeline(), that generates a big structure with everything to show in a timeline, to be passed to the HTML renderer (2022-10-01T20:27:52+0200). 146 147 Implement the helper thread (2022-10-01T20:56:46+0200). 148 149 Implement the user-setup web interface (2022-10-02T17:45:03+0200). 150 151 Implement the local timeline cache (2022-10-02T18:17:27+0200). 152 153 Implement the h/ (history) path (2022-10-02T18:23:24+0200). 154 155 Import the man pages (2022-10-03T21:38:23+0200). 156 157 Implement the 'init' command-line option (2022-10-04T09:55:56+0200). 158 159 Implement the 'adduser' command-line option (2022-10-04T09:55:56+0200). 160 161 Implement the purge (2022-10-04T18:52:00+0200). 162 163 Implement the citations as @user@host in the reply textareas (2022-10-06T19:08:39+0200). 164 165 Show dates in local time and not UTC (2022-10-06T19:45:53+0200). 166 167 Embed videos (2022-10-10T08:25:39+0200). 168 169 Implement image attachments (2022-10-10T09:04:22+0200). 170 171 build_mentions() should not query the webfinger (and it's disabled by now); process_message() should 'complete' the tag Mentions that don't include a host (2022-10-10T09:45:57+0200). 172 173 Process the timeline html from a dedicated thread (2022-10-10T20:08:35+0200). 174 175 Implement the s/ (static) path (2022-10-11T08:52:09+0200). 176 177 Implement image upload (2022-10-16T20:08:16+0200). 178 179 Implement the :emojis: in actor names and messages (2022-10-17T12:12:58+0200). 180 181 Implement notification by email of private messages (2022-10-28T21:17:27+0200). 182 183 Make local likes / announces more visible (2022-10-28T21:18:41+0200). 184 185 Implement sensitive messages: they have a non-empty `summary` field and a `sensitive` field set to *true* (2022-10-30T06:19:13+0100). 186 187 Add web interface for sending private messages (they can already be answered like normal replies) (2022-11-02T11:07:40+0100). 188 189 Add web interface for the list of people being followed and who follows us (2022-11-02T11:07:40+0100). 190 191 Add a 'Hide' button, to stop showing a post and its children (2022-11-04T09:45:39+0100). 192 193 Add a purge timeout also for the local timeline (2022-11-12T08:32:56+0100). 194 195 Add a switch for sensitive posts (2022-11-16T12:17:50+0100). 196 197 Add an RSS to the local timeline (2022-11-18T11:43:54+0100). 198 199 Dropping on input those messages that have their parent hidden is not a good idea, as children of *these* dropped messages will pass unharmed (2022-11-28T11:34:56+0100). 200 201 Idea for a new disk layout: timelines stored like in git (2 character directories and then the md5.json inside); one append-only index with entry ids, read backwards (easy because md5 binary ids have a constant size); children lists as append-only files stored inside the timeline directories with almost the same names as the parent entry; liked-by and announced-by lists as append-only files of actor ids. No _snac metadata inside the message (But, what about the referrer? With this layout, do I need it?). The instance storage may even be global, not per user; this could help in very big instances (but will this be a use-case for snac? not probably) (2022-12-04T06:49:55+0100). 202 203 Add this pull request https://codeberg.org/grunfink/snac2/pulls/9 (2022-12-05T12:12:19+0100). 204 205 Add an ?skip=NNN parameter to the admin page, to see older timeline (2022-12-08T08:41:11+0100). 206 207 Now that we have the 2.7 layout and Likes and Announces don't move the conversations up, finally fix the ugly # positioning (2022-12-08T08:41:27+0100). 208 209 Disable the 'Boost' button for non-public messages (technically they can be Announced, but shouldn't) (2022-12-08T08:46:24+0100). 210 211 Add support for Update + Note on input (2022-12-15T11:06:59+0100). 212 213 Hashtags have broken the Emojis; fix this (2023-01-17T09:42:17+0100). 214 215 Integrate https://codeberg.org/alderwick/snac2/commit/a33686992747f6cbd35420d23ff22717938b622 (2023-01-22T20:28:52+0100). 216 217 Add support for editing our own messages (2023-01-25T18:36:16+0100). 218 219 Implement hashtags. They are not very useful, as they can only be implemented as instance-only (not propagated), but it may help classifiying your own posts (2023-01-26T14:39:51+0100). 220 221 Refactor the queue to be global, not per user (2023-02-03T20:49:31+0100). 222 223 If there is a post in private.idx that has a parent that is in the global object database, this parent will be inserted into the list by timeline_top_level(). BUT, the new function timeline_get_by_md5() (that only looks in the user caches) won't find the parent, so the full thread will not be shown. This is BAD (2023-02-08T13:48:12+0100). 224 225 Move the output messages to the global queue (2023-02-10T12:17:30+0100). 226 227 Refactor the global queue to use a pool of threads (2023-02-10T12:17:38+0100). 228 229 Add a user-settable `purge_days`. This is not at first very hard to do, but purging posts from a user cache directory does not also delete them from the global object database and they will be kept in the indexes (unless they are also deleted from the indexes, which is a too expensive operation); this way, if another user in the same instance follows you, your posts will not disappear as you desire and that may be confusing and annoying. A different way to implement this: configure a maximum number of entries to keep and truncate the indexes in the purge. But this does not clear the disk usage, which is why I want to implement this (to implement bots that generate posts periodically and avoid the disks exploding) (2023-02-10T12:18:42+0100). 230 231 Add support for uploading the avatar, instead of needing an URL to an image. As a kludgy workaround, you can post something with an attached image, copy the auto-generated URL and use it. You can even delete the post, as attached images are never deleted (I said it was kludgy) (2023-02-15T09:31:06+0100). 232 233 Child indexes (*_c.idx) with a parent not present keep accumulating; not a real problem, but I must check why I keep storing them because I don't remember (2023-02-25T18:15:30+0100). 234 235 There are some hosts that keep returning 400 Bad Request to snac posts (e.g. hachyderm.io). I've investigated but still don't know where the problem is (2023-03-07T10:28:21+0100). 236 237 Fix `Like` and `Update` recipients (2023-03-07T10:28:36+0100). 238 239 Implement the ActivityPub C2S (Client to Server) API: https://www.w3.org/TR/activitypub/#client-to-server-interactions . The Android client at http://andstatus.org/ implements it, or so it seems. UPDATE: Wrong, AndStatus starts doing an OAuth query, that is totally not ActivityPub C2S. The number of real ActivityPub C2S clients out there is probably zero. Abandoned now that I'm implementing the Mastodon API (2023-04-12T15:00:14+0200). 240 241 Edits do not refresh the HTML cache (2023-04-14T19:05:27+0200). 242 243 Add a notification area, where recent events of interest would be easily seen (2023-04-21T23:20:27+0200). 244 245 Mastodon API: add search by account (webfinger) (2023-04-24T05:01:03+0200). 246 247 Mastodon API: add an instance timeline by combining the timelines of all users (2023-04-24T05:01:14+0200). 248 249 Mastodon API: implement 'unfavourite' (2023-05-19T21:25:24+0200). 250 251 Mastodon API: implement 'unreblog' (unboost) (2023-05-19T21:25:24+0200). 252 253 Do something with @mentions without host; complete with followed people, or with local users. Or just do nothing. I'm not sure (2023-05-21T20:19:15+0200). 254 255 Add (back) the possibility to attach an image by URL (2023-05-21T20:35:39+0200). 256 257 Fix broken links that contain # (https://codeberg.org/grunfink/snac2/issues/47#issuecomment-937014) (2023-06-12T19:03:45+0200). 258 259 Fix premature purge of actor by hardlinking the actor object inside the user `following/` subfolder (2023-06-15T04:30:40+0200). 260 261 Replace weird, vestigial 'touch-by-append-spaces' in actor_get() with a more proper call to `utimes()` (2023-06-23T06:46:56+0200). 262 263 With this new disk layout, hidden posts (and their children) can be directly skipped when rendering the HTML timeline (are there any other implications?) (2023-06-23T06:48:51+0200). 264 265 Implement HTTP caches (If-None-Match / ETag) (2023-07-02T11:11:20+0200). 266 267 Add a quick way to block complete domains / instances (2023-07-04T14:35:44+0200). 268 269 _object_user_cache() should call index_del() (2023-07-04T14:36:37+0200). 270 271 Add a content warning description (2023-07-04T15:02:19+0200). 272 273 Propagate the CW status and description from the replied message (2023-07-04T15:02:19+0200). 274 275 Add support for pinning posts (2023-07-06T10:11:35+0200). 276 277 index_list() and index_list_desc() should not return deleted (i.e. dash prefixed) entries (2023-07-06T10:12:06+0200). 278 279 Improve support for audio attachments (2023-07-28T20:22:32+0200). 280 281 Test all the possible XSS vulnerabilities in https://raw.githubusercontent.com/danielmiessler/SecLists/master/Fuzzing/big-list-of-naughty-strings.txt (2023-07-28T20:23:21+0200). 282 283 The outbox should contain Create+Note, not Note objects (2023-07-29T15:29:24+0200). 284 285 Add a per-account toggle to [un]mute their Announces (2023-08-08T13:25:40+0200). 286 287 The votersCount field in multiple-choice polls is incorrectly calculated (2023-08-08T13:56:28+0200). 288 289 Fix boosts from people being followed not showing in the Mastodon API (2023-11-18T22:42:48+0100). 290 291 Fix case-sensitivity issue described in https://codeberg.org/grunfink/snac2/issues/82 (2023-11-18T22:42:48+0100). 292 293 Implement real tag links instead of just pretending that it's something that exists (2023-11-18T22:42:48+0100). 294 295 Add a flag to make accounts private, i.e., they don't expose any content from the web interface (only through ActivityPub) (2023-11-18T22:42:48+0100). 296 297 Fix duplicate mentions, see https://codeberg.org/grunfink/snac2/issues/115 (2024-02-14T09:51:01+0100). 298 299 Change HTML metadata information to the post info instead of user info, see https://codeberg.org/grunfink/snac2/issues/116 (2024-02-14T09:51:22+0100). 300 301 Add support for rel="me" links, see https://codeberg.org/grunfink/snac2/issues/124 and https://streetpass.social (2024-02-22T12:40:58+0100). 302 303 Hide followers-only replies to unknown accounts, see https://codeberg.org/grunfink/snac2/issues/123 (2024-02-22T12:40:58+0100). 304 305 Consider implementing the rejection of activities from recently-created accounts to mitigate spam, see https://akkoma.dev/AkkomaGang/akkoma/src/branch/develop/lib/pleroma/web/activity_pub/mrf/reject_newly_created_account_note_policy.ex (2024-02-24T07:46:10+0100). 306 307 Consider discarding posts by content using string or regex to mitigate spam (2024-03-14T10:40:14+0100). 308 309 Post edits should preserve the image and the image description somewhat (2024-03-22T09:57:18+0100). 310 311 Integrate "Ability to federate with hidden networks" see https://codeberg.org/grunfink/snac2/issues/93 312 313 Consider adding milter-like support to reject posts to mitigate spam (discarded; 2024-04-20T22:46:35+0200). 314 315 Implement support for 'Event' data types. Example: https://fediversity.site/item/e9bdb383-eeb9-4d7d-b2f7-c6401267cae0 (2024-05-12T08:56:27+0200) 316 317 Mastodon API: fix whatever the fuck is making the official app and Megalodon to crash (2024-06-02T07:43:35+0200). 318 319 Implement `Group`-like accounts (i.e. an actor that boosts to their followers all posts that mention it) (2024-08-01T18:51:43+0200). 320 321 Show pinned posts in the 'Actor' `featured` property (https://codeberg.org/grunfink/snac2/issues/191) (2024-08-27T07:28:51+0200). 322 323 Implement case-insensitive search all alphabets, not only latin (https://codeberg.org/grunfink/snac2/issues/192) (2024-08-27T07:29:10+0200). 324 325 Add post drafts (2024-09-06T23:43:16+0200). 326 327 Implement account migration from snac to Mastodon (2.60, 2024-10-11T04:25:54+0200). 328 329 Fix mastoapi timelines/public, it only shows posts by the user (2.61, 2024-10-11T04:25:54+0200). 330 331 Fix over-zealous caching in /public after changing the bio (2.61, 2024-10-13T06:50:03+0200). 332 333 Implement account migration from Mastodon to snac (2.61, 2024-10-13T06:50:03+0200). 334 335 Don't show image attachments which URLs are already in the post content (2.62, 2024-10-27T09:03:49+0100). 336 337 Add a user option to always collapse first level threads (2.62, 2024-10-28T14:50:42+0100). 338 339 Add a `disable_block_notifications` flag to server settings (2.62, 2024-10-30T16:58:16+0100). 340 341 The `strict_public_timelines` is broken, as it also applies to the private timeline (2.63, 2024-11-07T21:44:52+0100). 342 343 Fix a crash when posting from the links browser (2.63, 2024-11-08T15:57:25+0100). 344 345 Fix some repeated images in Lemmy posts (2.63, 2024-11-08T15:57:25+0100). 346 347 Fix a crash when posting an image from the tooot mobile app (2.63, 2024-11-11T19:42:11+0100). 348 349 Fix some URL proxying (2.64, 2024-11-16T07:26:23+0100). 350 351 Allow underscores in hashtags (2.64, 2024-11-16T07:26:23+0100). 352 353 Add a pidfile (2.64, 2024-11-17T10:21:29+0100). 354 355 Implement Proxying for Media Links to Enhance User Privacy (see https://codeberg.org/grunfink/snac2/issues/219 for more information) (2024-11-18T20:36:39+0100). 356 357 Consider showing only posts by the account owner (not full trees) (see https://codeberg.org/grunfink/snac2/issues/217 for more information) (2024-11-18T20:36:39+0100). 358 359 Unfollowing lemmy groups gets rejected with an http status of 400 (it seems to work now; 2024-12-28T16:50:16+0100). 360 361 CSV import/export does not work with OpenBSD security on; document it or fix it (2025-01-04T19:35:09+0100). 362 363 Add support for /share?text=tt&website=url (whatever it is, see https://mastodonshare.com/ for details) (2025-01-06T18:43:52+0100). 364 365 Add support for /authorize_interaction (whatever it is) (2025-01-16T14:45:28+0100). 366 367 Implement following of hashtags (this is not trivial) (2025-01-30T16:12:16+0100). 368 369 Add support for subscribing and posting to relays (see https://codeberg.org/grunfink/snac2/issues/216 for more information) (2025-01-30T16:12:34+0100). 370 371 Wrong level of message visibility when using the Mastodon API: https://codeberg.org/grunfink/snac2/issues/200#issuecomment-2351042 (2025-03-23T15:44:35+0100). 372 373 Each notification should show a link to the full thread, to see it in context (2025-03-23T15:44:50+0100). 374 375 Add a list of hashtags to drop (2025-03-23T15:45:30+0100). 376 377 The actual storage system wastes too much disk space (lots of small files that really consume 4k of storage). Consider alternatives (2025-03-23T15:46:02+0100). 378 379 Add command-line tools for creating and manipulating lists (2025-04-18T10:04:41+0200). 380 381 Do a [Webmention](https://www.w3.org/TR/webmention/) to every link written in a post (2025-05-04T11:16:21+0200).