Abuse prevention #4

New issue

Open

opened 2024-06-29 17:39:48 +00:00 by sofia · 0 comments

sofia commented

2024-06-29 17:39:48 +00:00

Owner

Users cannot directly share their memories (their heirs can access them, but they must request to do so), but they can theoretically share their assets with anyone using their session_key. This may be an useful feature, but we should keep in mind that this is a feature that may be abused by malicious third parties.

A server that blindly hosts and serves images and videos can lead to undesirable things such as hosting and sharing CSAM content, other illegal media, malware, etc. In order to comply with my moral and ethical principles, and European law, this must be addressed before hosting an instance.

Key points

Balance usability and likelihood of abuse.
Implement reporting systems, both automated and manual.
- Perceptual hashes can be useful, but mainstream services like PhotoDNA are a privacy concern.
- Develop a moderation panel that can be used to monitor suspicious activity and content by platform moderators.
- AI systems with manual intervention have proven to be effective in cases like these; research is required.
Improve the M2M mechanism to stop relying on the session_key.
Improve the Asset API implementation to only serve images to the IP they were requested from.
#1

Users cannot directly share their memories (their heirs can access them, but they must request to do so), but they can theoretically share their assets with anyone using their `session_key`. This may be an useful feature, but we should keep in mind that this is a feature that may be abused by malicious third parties. A server that blindly hosts and serves images and videos can lead to undesirable things such as hosting and sharing CSAM content, other illegal media, malware, etc. In order to comply with my moral and ethical principles, and European law, this must be addressed before hosting an instance. **Key points** - [ ] Balance usability and likelihood of abuse. - [ ] Implement reporting systems, both automated and manual. - Perceptual hashes can be useful, but mainstream services like PhotoDNA are a privacy concern. - Develop a _moderation panel_ that can be used to monitor suspicious activity and content by platform moderators. - AI systems with manual intervention have proven to be effective in cases like these; research is required. - [ ] Improve the M2M mechanism to stop relying on the `session_key`. - [ ] Improve the Asset API implementation to only serve images to the IP they were requested from. - [ ] #1