I would recommend Backblaze B2 storage instead of removing post history.
The problem with post removal is that it will affect all other instances’ as you don’t (by default) cache original images from other fediverse instances (iirc)
So for example, my instance Reddthat will reference an image hosted on your instance, which will then 404. (But the thumbnail will be cached (I think))
Backblaze is dirt cheap and the pictrs object migration is now multi threaded making it very easy to migrate now. I was hosting 15GB and it amounted to bills of cents! $5/TB or $0.005 per GB. If you add CloudFlare Infront you then get free egress! Or any CDN that is part of the “Bandwidth alliance”. I now have ~120GB of pictrs storage. After 2-3 months.
Also, there was a recent chat on the lemmy admin matrix channel about setting some variable in pictrs so it does not cache any images. But I don’t remember what it was so maybe check the pictrs documentation.
Do you put cloudflare between the VPS and Backblaze or is their website just referring to “CDN and compute partners” between the VPS and the end users? … Or both?
Because Lemmy does not have a way to have all media served from a different url/subdomain (like a CDN). Your setup will be:
cloudflare > vps
vps > backblaze
Basically just put cloudflare infront of your vps, and cache everything.
That means if a user uploaded a 10MB file, it would go though your VPS, get uploaded to backblaze. When a user looks at the uploaded image url, on the first request it gets requested from blackblaze, via your vps, and then gets cached on Cloudflare.
Then any extra requests from then on will be via Cloudflare. So you will technically be charged for some api requests and 1x 10MB of egress traffic.
Sounds like a normal setup then. Just have CF in front of the VPS. Thanks!
I’m reading about Canadian hosting laws around user generated content and it doesn’t seem like we have the same protections the US or EU has. I’m still reading but my big concern is legal trouble because of end users. If I don’t selfhost for the community I’ll offer to help an instance I like.
Dont know how and why but my reverse proxy died in a pretty weird way. Clearing my DNS servers cache and restarting caddy did it
Pihole was to stupid to update dns which lead to caddy shitting itself and killing my entire homelab
I use Wasabi storage which is more expensive as they have a minimum space allotment but because my servers are in Aus I had issues with backblaze b2 storage and the latency. (I was dealing with 200-300ms in network latency AU -> US + the time that backblaze takes to store the data).
At that time lemmy/pictrs was not as optimised as it is now so it’s much better now.
Backblaze comes out WAY cheaper per-month if you have servers in us/eu, as close to their regions as possible, but they also charge you for API.
As part of an Object Storage / cdn remember you also might have to pay for egress charges as well. Cloudflare is part of the “Bandwidth Alliance” but that isn’t applicable here as pictrs needs to present the images via its own domain, (such as cdn.reddthat.com). So you’ll still want a CDN infront which will mean you will only pay once for the egress instead of everytime everyone loads it.
Minio’s free tier is a host-it-yourself. Where as their paid tier are for actual storage hosters, they have a minimum of 100TB/month @ $10/TB.
B2 has no minimum, and egress + hosting of 20GB cost me… ($0.29)
Note: They still havn’t billed me because I havn’t passed the $1 mark yet!
Wasabi (my current choice) is $7/TB (AU, US is $6/TB iirc) with a minimum of 1TB/month with out egress or api charges
Reddthat has… looks up 150GB of object storage now.
I would recommend B2 if you are starting out and are in US/EU. Wasabi in all other regions and have a CDN infront. (and don’t mind burning a little cash for peace of mind)
You’d probably need to see if they have a way to directly contact them, as this community is primarily for those looking for assistance with running/configuring their own Lemmy instance.
There are some posts you don’t need to troll on. These include admin posts about server updates. I understand your stance against it, and dare say I agree with it wholeheartedly, but they are our dictators on this forum.
So while I’m all for flipping off a cop and saying fuck the system, you must admit we don’t have the same rights here as we would in a society.
you must admit we don’t have the same rights here as we would in a society.
I’d disagree, and actually say that you have even more “rights”. You can move to another instance, or even start up your own. The equivalent (moving to a different country/city/town, or starting your own) is a bit harder to pull off depending on your situation.
The next major release will even have an account settings export/import feature to make this a bit easier. Or for now, you can use something like LASIM.
Well, I meant it quite literally. We certainly don’t have a Bill of Rights or anything related. The Terms of Service are rules we must not break, but technically there are no rules protecting us from the admins of the site. We sure are free to leave, but we are not “free” to protest in any way we see fit. So we are at the mercy of the admins if we wish to stay on this site.
Ah, that’s not likely to be found at any site really (that I know of at least). That model makes sense for governments, but for websites its not like you’re able to vote in a new site owner (well, strictly speaking from an independent run website and not one that’s run by a corporation cough Reddit - even then, you can’t really just vote out Reddit Inc as a whole).
But, America was founded because they didn’t want to be connected to a government they felt like they had no influence in, thus splitting off to form their own government - it’s very easy to do the same for Lemmy (you could even go as far as Hexbear did, and fork Lemmy and maintain your own version).
I’m not familiar with any websites that are run in the way that you’re referring to, but I’d be interested to see one and how it shapes up (even if I wouldn’t be interested in running one myself), though I’m not sure how the logistics of it would work. However, I’ve seen the idea come up a few times in the past before so I wouldn’t be surprised if there’s one out there (or at least, in the past).
Personally I see the analogy is a a bit silly for a site that takes place in the Fediverse. If you break a law in most places, you get thrown in jail. On a Lemmy/Fediverse instance, if you break the rules you get banned - but can start a new account elsewhere and participate in the same communities (for better or for worse). This exact community isn’t even hosted on lemmy.world, so the definition of “site” in the Fediverse is a much less important abstraction than it would be if you were to say, be banned off of Reddit, hence why I keep circling back to moving instances/standing up your own.
You need smtp_login and smtp_password there. Not sure what that is for Sendgrid however. It might be your accoint sername/email and the API key. Sendgrid probably has docs for their SMTP server.
The pending subscription is a known thing. If you retract the subscription and then redo it, it should be good. If not, wait a bit and retry. You may have to reload the page so see the button change to “Subscribed”.
Not sure about the other though. In my experience, purging and refetching a community will always fix it… :/
I’ll pass this post to the admin Matrix chat (which you should join), since it’s important to have this kind of info publicly and readily available as well.
Yeah. I looks like the beehaw thing has resolved itself. I don’t know why it was just them but I have been able to subscibe since yesterday. I’m guessing that this is an issue with the source instance rather than the requesting instance - maybe it’s not sending out an accept activity like it should.
I’m still seeing the lack of content in newly searched communities though. sh.itjust.works/c/plugins for instance just refuses to come back with anything.
Your instance won’t start fetching any posts from a community, until someone from your instance subscribes to it. Then it will fetch the last 25 posts (I think) and then all future posts.
I don’t think that’s true. Searching for a community typically brings back a fully populated page. None of the posts have comments or up/down votes, but they’re all there.
I’d say in maybe 20% of cases though it comes back empty.
If you search for a community first time, 20 posts are fetched initially. Only if a least one user on your instance subscribes to the remote community, will the community send updates to your instance.
The point is I’m not getting 20 posts. I get nothing. I can subscribe and then get posts from that point forward as I’d expect.
Yeah, sadly not working on communities that exhibit this issue. This one (!lemmy_admin) is one. I have two posts showing on my instance, this one and another that seems to have been updated recently.
If I search for lemmy.ml/post/6417868 using my instances search I get no results found. The error in the logs is
<span style="color:#323232;">2023-11-10T10:20:48.585813Z WARN Error encountered while processing the incoming HTTP request: lemmy_server::root_span_builder: couldnt_find_object: data did not match any variant of untagged enum SearchableKinds
</span><span style="color:#323232;"> 0: lemmy_apub::fetcher::search::search_query_to_object_id
</span><span style="color:#323232;"> at crates/apub/src/fetcher/search.rs:19
</span><span style="color:#323232;"> 1: lemmy_apub::api::resolve_object::resolve_object
</span><span style="color:#323232;"> with data=Query(ResolveObject { q: "https://lemmy.ml/post/6417868", auth: Some(Sensitive) })
</span><span style="color:#323232;"> at crates/apub/src/api/resolve_object.rs:19
</span><span style="color:#323232;"> 2: lemmy_server::root_span_builder::HTTP request
</span><span style="color:#323232;"> with http.method=GET http.scheme="http" http.host=doomscroll.n8e.dev http.target=/api/v3/resolve_object otel.kind="server" request_id=4ef4bf5c-228f-4268-b798-3561a79d9a2f http.status_code=400 otel.status_code="OK"
</span><span style="color:#323232;"> at src/root_span_builder.rs:16
</span><span style="color:#323232;">
</span><span style="color:#323232;">LemmyError { message: Some("couldnt_find_object"), inner: data did not match any variant of untagged enum SearchableKinds, context: SpanTrace [{ target: "lemmy_apub::fetcher::search", name: "search_query_to_object_id", file: "crates/apub/src/fetcher/search.rs", line: 19 }, { target: "lemmy_apub::api::resolve_object", name: "resolve_object", fields: "u{1b}[3mdatau{1b}[0mu{1b}[2m=u{1b}[0mQuery(ResolveObject { q: "https://lemmy.ml/post/6417868", auth: Some(Sensitive) })", file: "crates/apub/src/api/resolve_object.rs", line: 19 }, { target: "lemmy_server::root_span_builder", name: "HTTP request", fields: "u{1b}[3mhttp.methodu{1b}[0mu{1b}[2m=u{1b}[0mGET u{1b}[3mhttp.schemeu{1b}[0mu{1b}[2m=u{1b}[0m"http" u{1b}[3mhttp.hostu{1b}[0mu{1b}[2m=u{1b}[0mdoomscroll.n8e.dev u{1b}[3mhttp.targetu{1b}[0mu{1b}[2m=u{1b}[0m/api/v3/resolve_object u{1b}[3motel.kindu{1b}[0mu{1b}[2m=u{1b}[0m"server" u{1b}[3mrequest_idu{1b}[0mu{1b}[2m=u{1b}[0m4ef4bf5c-228f-4268-b798-3561a79d9a2f u{1b}[3mhttp.status_codeu{1b}[0mu{1b}[2m=u{1b}[0m400 u{1b}[3motel.status_codeu{1b}[0mu{1b}[2m=u{1b}[0m"OK"", file: "src/root_span_builder.rs", line: 16 }] }
</span>
Wish I knew. Their DNS record is still up on NameCheap and it’s not like there is zero server at all (domain not found), my browser resolves the name fine so its being refreshed, it just never loads any data when I browse to it.
Maybe their backend fell over and their admin hasn’t realized it yet. Idk.
lemmy_admin
Oldest
This magazine is from a federated server and may be incomplete. Browse more on the original instance.